Smart mirror system and methods of use thereof

ABSTRACT

A system comprising a mirror having a first side and second side, the mirror permitting a first portion of light incident on the first side to transmit therethrough and permitting a second portion of the incident light to reflect therefrom; an electronic display positioned adjacent to the second side of the mirror such that the electronic display is at least partially visible through the first side of the mirror responsive to the electronic display being at least partially activated; one or more sensors positioned generally about a periphery of the mirror configured to detect a presence and relative location of an object positioned adjacent to the first side of the mirror; a light source configured to emit light and at least partially aid in illuminating the object responsive to the object being adjacent to the first side of the mirror; and a camera configured to detect the object.

CROSS REFERENCE TO RELATED APPLICATION

This application claims priority to and benefit of U.S. ProvisionalPatent Application No. 62/614,409, filed Jan. 6, 2018, which is herebyincorporated by reference herein in its entirety.

TECHNICAL FIELD

The present disclosure relates to an interactive mirror device, morespecifically, the present disclosure relates to an interactive mirrorwith the ability to recognizes faces and objects.

BACKGROUND

In their daily lives, people perform many tasks in front of mirrors,such as brushing their teeth, shaving, applying makeup, and generallygetting ready for their day. These activities are often undertaken inpoor lighting conditions and can cause people problems in notsufficiently being prepared for their day. For example, a person mayapply their makeup incorrectly due to inadequate lighting in theirbathroom or bedroom where their mirror is located. In another example, aperson may not be able to see their face properly when shaving, causingthem to miss spots. In an additional example, the ambient lightingconditions may not be a realistic estimate of the actual lightingconditions a person will experience throughout the day, and thus theperson cannot ensure that they have sufficiently prepared themselveswhen they can only view themselves in in adequate lighting. The presentdisclosure is directed to solving these problems and addressing otherneeds.

SUMMARY

According to other implementations of the present disclosure, a systemcomprises a mirror having a first side and an opposing second side, themirror being configured to permit a first portion of light incident onthe first side to transmit therethrough and to permit a second portionof the light incident on the first side to reflect therefrom; anelectronic display positioned adjacent to the second side of the mirrorsuch that the electronic display is at least partially visible throughthe first side of the mirror responsive to the electronic display beingat least partially activated; one or more sensors positioned generallyabout a periphery of the mirror and being configured to detect apresence of and a relative location of an object positioned adjacent tothe first side of the mirror; a light source configured to produce lightand at least partially aid in illuminating the object responsive to theobject being adjacent to the first side of the mirror; and a cameraconfigured to detect the object.

According to other implementations of the present disclosure, a methodof modifying execution an application comprises providing an electronicdisplay device and a mirror, the mirror having a first side and anopposing second side, the electronic display device being positionedadjacent to the second side of the mirror such the electronic displaydevice is at least partially visible through the first side of themirror responsive to the electronic display device being activated;executing, on one or more processing devices communicatively coupled tothe electronic display device, a first application; displaying, on theelectronic display device, a first type of information related to thefirst application; monitoring an area adjacent to the first side of themirror with a camera communicatively coupled to the one or moreprocessing devices; detecting, with the one or more processing devices,an object disposed in the area adjacent to the first side of the mirror;identifying, with the one or more processing devices, the detectedobject from a plurality of pre-determined potential objects; andresponsive to identifying the detected object, modifying the executionof the first application based on the identified detected object.

According to further implementations of the present disclosure, a methodof illuminating a face comprises providing an electronic display deviceand a mirror, the mirror having a first side and an opposing secondside, the electronic display device being positioned adjacent to thesecond side of the mirror such the electronic display device is at leastpartially visible through the first side of the mirror responsive to theelectronic display device being activated; monitoring an area adjacentto the first side of the mirror with one or more sensors; detecting,with the one or more sensors, the face responsive to the face beingpositioned within a threshold distance from a surface of the mirror onthe second side of the mirror; determining, using one or more processorscommunicatively coupled to the one or more sensors, an outer peripheryof the face; and activating a portion of the electronic display deviceto illuminate the face.

According to still further implementations of the present disclosure, amethod of compensating for ambient light conditions comprises providingan electronic display device and a mirror, the mirror having a firstside and an opposing second side, the electronic display device beingpositioned adjacent to the second side of the mirror such the electronicdisplay device is at least partially visible through the first side ofthe mirror responsive to the electronic display device being activated;detecting, using an ambient light sensor, the ambient light conditionilluminating an object; determining, using one or more processorscommunicatively coupled to the ambient light sensor, a differencebetween the detected ambient light condition and a desired lightcondition; producing light using one or more lighting sources based onthe determined difference between the ambient light condition and thedesired light condition; and illuminating the object with the producedlight such that the ambient light condition and the produced lightcombine to cause the object to be illuminated according to the desiredlighting condition.

According to yet other implementation of the present disclosure, amethod of capturing an image of a user comprises providing an electronicdisplay device and a mirror, the mirror having a first side and anopposing second side, the electronic display device being positionedadjacent to the second side of the mirror such the electronic displaydevice is at least partially visible through the first side of themirror responsive to the electronic display device being activated;illuminating, using light produced by one or more light sources, a userlocated adjacent to the first side of the mirror; capturing, using acamera, images of the user located adjacent to the first side of themirror; displaying on the electronic display device the captured imagesof the user; displaying, on the electronic display device, one or moreuser-selectable icons, each icon corresponding to a different lightingcondition; detecting a user selection of at least one of the one or moreuser-selectable icons; adjusting the light produced by the one or morelight sources based on the user selection of the at least one of the oneor more user-selectable icons such that the user is illuminated by aselected lighting condition; and capturing, using the camera, an imageof the user.

According to additional implementations of the present disclosure, asystem comprises a mirror having a first side and an opposing secondside, the mirror being configured to permit a first portion of lightincident on the first side to transmit therethrough and to permit asecond portion of the light incident on the first side to reflecttherefrom; a first electronic display positioned adjacent to the secondside of the mirror such that the first electronic display is at leastpartially visible through the first side of the mirror responsive to thefirst electronic display being at least partially activated; a secondelectronic display positioned adjacent to the second side of the mirrorsuch that the second electronic display is at least partially visiblethrough the first side of the mirror responsive to the second electronicdisplay being at least partially activated, the second electronicdisplay being spaced apart from the first electronic display such that agap is defined between the first electronic display and the secondelectronic display; one or more sensors positioned generally about aperiphery of the mirror and being configured to detect a presence of anda relative location of an object positioned adjacent to the first sideof the mirror; a light source configured to produce light and at leastpartially aid in illuminating the object responsive to the object beingadjacent to the first side of the mirror; and a camera configured todetect the object, the camera being positioned adjacent the second sideof the mirror and in the gap between the first electronic display andthe second electronic display.

According to some implementations of the present disclosure, a systemcomprises a frame; a mirror coupled to the frame, the mirror having afirst side and an opposing second side, the mirror being configured topermit a first portion of light incident on the first side to transmittherethrough and to permit a second portion of the light incident on thefirst side to reflect therefrom; an electronic display couple to theframe such that the electronic display is positioned adjacent to thesecond side of the mirror; a plurality of sensors positioned generallyabout at least a portion of a periphery of the mirror and beingconfigured to detect a presence of and a relative location of an objectpositioned adjacent to the first side of the mirror; camera positionedadjacent the second side of the mirror and positioned such that theobject is within a field of view of the camera responsive to the objectbeing positioned adjacent to the first side of the mirror; and anobstruction coupled the frame and being configured move between a firstposition where the obstruction obscures the field of view of the cameraand a second position where the obstruction does not obscure the fieldof view of the camera.

According to some implementations of the present disclosure, a systemcomprises a frame; a mirror coupled to the frame; an electronic displaycouple to the frame such that the electronic display is positionedadjacent to a rear side of the mirror; a camera coupled to the framesuch that a field of view of the camera includes an area adjacent to afront side of the mirror; and an obstruction coupled the frame and beingconfigured move between a first position and a second position,responsive to the obstruction being in the first position, theobstruction is configured to obscure at least a portion of the field ofview of the camera, responsive to the obstruction being in the secondposition, the obstruction is configured to not obscure the field of viewof the camera.

According to some implementations of the present disclosure, a systemfor providing a tutorial comprises a smart mirror device including: aframe; a mirror coupled to the frame; an electronic display devicecoupled to the frame such that the electronic display device ispositioned adjacent to a portion of the mirror; and one or moreprocessors configured to execute instructions stored in one or morememory devices such that the smart mirror device is caused to:responsive to receiving an input to begin a first tutorial, display, onthe electronic display device, (i) a first looping video illustrating ahuman performing a how-to tutorial for a first type of activity, (ii) asecond looping video illustrating an animation associated with thehow-to tutorial shown in the first looping video, and (iii) a real-timevideo feed of a user; and responsive to receiving a magnifier inputassociated with a portion of the user in the displayed real-time videofeed, display, on the electronic display device, a zoomed in view of theuser including the portion of the user.

According to some implementations of the present disclosure, a systemfor providing a tutorial comprises a frame; a mirror coupled to theframe; an electronic display device coupled to the frame such that theelectronic display device is positioned adjacent to a portion of themirror; and one or more processors configured to execute instructionsstored in one or more memory devices such that the system is caused to:responsive to receiving an input to begin a first tutorial, display, onthe electronic display device, a first looping video illustrating ahuman performing a how-to tutorial for a first type of activity.

According to some implementations of the present disclosure, a systemfor providing a tutorial comprises a frame; a mirror coupled to theframe; an electronic display device coupled to the frame such that theelectronic display device is positioned adjacent to a portion of themirror; and one or more processors configured to execute instructionsstored in one or more memory devices such that the system is caused to:responsive to receiving an input to begin a first tutorial, display, onthe electronic display device, (i) a first looping video illustrating ahuman performing a how-to tutorial for a first type of activity and (ii)a real-time video feed of a user; and modify the real-time video feed ofthe user to overlay on a portion of the user one or more templatefeatures associated with the first type of activity.

According to some implementations of the present disclosure, a systemfor capturing and displaying images of a user comprises a frame; amirror coupled to the frame; an electronic display device coupled to theframe such that the electronic display device is positioned adjacent toa portion of the mirror; a camera coupled to the frame; and one or moreprocessors configured to execute instructions stored in one or morememory devices such that the system is caused to: generate, using thecamera, video data associated with at least a portion of the user;display, on the electronic display device, the generated video data as areal-time video feed of at least a portion of the user; capture, fromthe video data, first image data reproducible as a first image of the atleast a portion of the user; display the first image and a first set ofselectable options, the first set of selectable options being associatedwith a first characteristic of the user; receive, via an input device, aselection of one of the first set of selectable options; and responsiveto receiving the selection of the one or the first set of selectableoptions, display a second image of the user, the second image of theuser being a modified version of the first image of the user andillustrating a proposed modification to the first characteristic of theuser, the modification being based on the selection of the one of thefirst set of selectable options.

According to some implementations of the present disclosure, a systemfor displaying images comprises a frame; a mirror coupled to the frame;an electronic display device coupled to the frame such that theelectronic display device is positioned adjacent to a portion of themirror; a camera coupled to the frame; and one or more processorsconfigured to execute instructions stored in one or more memory devicessuch that the system is caused to: display, on the electronic displaydevice, a real-time video feed of a user; capture first image datareproducible as a first image of the user; identify an object being heldby the user in the first image; and responsive to identifying the objectbeing held by the user in the first image, display a second image of theuser, the second image of the user being a modified version of the firstimage of the user, the modification being based on the identified objectbeing held by the user.

According to some implementations of the present disclosure, a systemfor displaying images comprises a frame; a mirror coupled to the frame;an electronic display device coupled to the frame such that theelectronic display device is positioned adjacent to a portion of themirror; a camera coupled to the frame; and one or more processorsconfigured to execute instructions stored in one or more memory devicessuch that the system is caused to: display, on the electronic displaydevice, a real-time video feed of a user; receive, via an input device,a selection of an area of interest of the user shown in the real-timevideo feed of the user; display, on the electronic display device, azoomed-in real-time video feed of the area of interest of the user; andcontinue to display, on the electronic display device, the zoomed-inreal time video feed of the area of interest of the user responsive tomovement of the user.

The foregoing and additional aspects and implementations of the presentdisclosure will be apparent to those of ordinary skill in the art inview of the detailed description of various embodiments and/orimplementations, which is made with reference to the drawings, a briefdescription of which is provided next.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing and other advantages of the present disclosure will becomeapparent upon reading the following detailed description and uponreference to the drawings.

FIG. 1 is a block diagram of a smart mirror system, according to someimplementations of the present disclosure;

FIG. 2 is a perspective view of the smart mirror system of FIG. 1,according to some implementations of the present disclosure;

FIG. 3A is a front elevation view of the smart mirror system of FIG. 1,according to some implementations of the present disclosure;

FIG. 3B is a side elevation view of the smart mirror system of FIG. 1,according to some implementation of the present disclosure;

FIG. 4A is a perspective view of the smart mirror system of FIG. 1showing a reflection of a user, according to some implementation of thepresent disclosure;

FIG. 4B is a perspective view of the smart mirror system of FIG. 1illuminating the user using a display mounted behind a mirror, accordingto some implementation of the present disclosure;

FIG. 5 is a flowchart illustrating a method of illuminating a user'sface using the smart mirror system of FIG. 1, according to someimplementations of the present disclosure;

FIG. 6A is an implementation of an electronic display of the smartmirror system of FIG. 1 when not illuminating the face of a user,according to some implementations of the present disclosure;

FIG. 6B is an implementation of an electronic display of the smartmirror system of FIG. 1 while illuminating the face of a user, accordingto some implementations of the present disclosure;

FIG. 7 is a flowchart illustrating a method of modifying an applicationbeing executed by the smart mirror system of FIG. 1 based on anidentified object, according to some implementations of the presentdisclosure;

FIG. 8 is a flowchart illustrating a method of illuminating a user andcompensating for ambient lighting conditions using the smart mirrorsystem of FIG. 1, according to some implementations of the presentdisclosure;

FIG. 9 is a flowchart illustrating a method of capturing an image of auser using the smart mirror system of FIG. 1, according to someimplementations of the present disclosure;

FIG. 10 is an implementation of an electronic display of the smartmirror system of FIG. 1 during the method of capturing an image of theuser, according to some implementations of the present disclosure;

FIG. 11A is an implementation of the smart mirror system including afirst electronic display, a second electronic display, and a cameralocated between them, according to some implementations of the presentdisclosure;

FIG. 11B is an implementation of the smart mirror system including afirst electronic display, a second electronic displays, and two cameraslocated between them, according to some implementations of the presentdisclosure;

FIG. 12 is an implementation of the smart mirror system with anoval-shaped mirror and a rectangular-shaped sensor frame, according tosome implementations of the present disclosure;

FIG. 13 is an implementation of the smart mirror system with arectangular-shaped mirror and a smaller rectangular-shaped sensor frame,according to some implementations of the present disclosure;

FIG. 14 is an implementation of the smart mirror system with the mirrordivided into an inner zone and two outer zones, according to someimplementations of the present disclosure;

FIG. 15 is an implementation of the smart mirror system with anobstruction at least partially blocking a field of view of the camera,according to some implementations of the present disclosure;

FIG. 16A is a top perspective view of the obstruction of FIG. 15,according to some implementations of the present disclosure;

FIG. 16B is a bottom perspective view of the obstruction of FIG. 15,according to some implementations of the present disclosure;

FIG. 17A is a view of the smart mirror system displaying the user and anobject the user is holding, according to some implementations of thepresent disclosure;

FIG. 17B is a view of the smart mirror system after the smart mirrorsystem identifies the object the user is holding, according to someimplementations of the present disclosure;

FIG. 18A is a view of a first step in a tutorial for applying eyeliner,according to some implementations of the present disclosure;

FIG. 18B is a view of a second step in a tutorial for applying eyeliner,according to some implementations of the present disclosure;

FIG. 18C is a view of a third step in a tutorial for applying eyeliner,according to some implementations of the present disclosure;

FIG. 19A is a view of a first stage of a magnification feature,according to some implementations of the present disclosure;

FIG. 19B is a view of a second stage of a magnification feature,according to some implementations of the present disclosure;

FIG. 20A is a view of a first step in a hair dying tutorial, accordingto some implementations of the present disclosure;

FIG. 20B is a view of a second step in a hair dying tutorial, accordingto some implementations of the present disclosure;

FIG. 20C is a view of a third step in a hair dying tutorial, accordingto some implementations of the present disclosure;

FIG. 20D is a view of a fourth step in a hair dying tutorial, accordingto some implementations of the present disclosure;

FIG. 20E is a view of a fifth step in a hair dying tutorial, accordingto some implementations of the present disclosure;

FIG. 20F is a view of a sixth step in a hair dying tutorial thatincludes a timer, according to some implementations of the presentdisclosure;

FIG. 21A is a view of the smart mirror system recording a 360° video ofa user, according to some implementations of the present disclosure;

FIG. 21B is a view of the smart mirror system displaying a 3D model ofthe user, according to some implementations of the present disclosure;

FIG. 22A is a view of the smart mirror system capturing a before imageof the user, according to some implementations of the presentdisclosure;

FIG. 22B is a view of the smart mirror system displaying the beforeimage to the user, according to some implementations of the presentdisclosure;

FIG. 22C is a view of the smart mirror system displaying a firstplurality of user-selectable options associated with a firstcharacteristic of the user where each user-selectable option representsa unique proposed modification to the first characteristic, according tosome implementations of the present disclosure;

FIG. 22D is a view of the smart mirror system displaying a secondplurality of user-selectable options associated with a secondcharacteristic of the user where each user-selectable option representsa unique proposed modification to the second characteristic, accordingto some implementations of the present disclosure;

FIG. 22E is a view of the smart mirror system displaying a plurality ofpotential modifications to the first characteristic, a plurality ofpotential modifications to the second characteristic, and the beforeimage, according to some implementations of the present disclosure;

FIG. 22F is a view of the smart mirror system displaying a selectedmodification to the first characteristic and a selected modification tothe second characteristic, according to some implementations of thepresent disclosure;

FIG. 22G is a view of the smart mirror system capturing am after imageof the user, according to some implementations of the presentdisclosure;

FIG. 22H is a view of the smart mirror system displaying both the beforeimage of the user and the after image of the user, according to someimplementations of the present disclosure; and

FIG. 23 is a view of the smart mirror system presenting the user optionsto adjust properties of light being emitted by the smart mirror system,according to some implementations of the present disclosure.

While the present disclosure is susceptible to various modifications andalternative forms, specific implementations and embodiments have beenshown by way of example in the drawings and will be described in detailherein. It should be understood, however, that the present disclosure isnot intended to be limited to the particular forms disclosed. Rather,the present disclosure is to cover all modifications, equivalents, andalternatives falling within the spirit and scope of the presentdisclosure as defined by the appended claims.

DETAILED DESCRIPTION

Referring to FIG. 1, a smart mirror system 10 according to the presentdisclosure includes a mirror 12, one or more electronic displays 14, oneor more sensors, one or more light sources 18, and one or more cameras20. The system generally also includes at least one processor 22 with amemory 24. The memory 24 generally contains processor-executableinstructions that when executed by the processor 22, run an operatingsystem and/or an application on the display 14. The mirror 12 is of atype that is generally referred to as a one-way mirror, although it isalso sometimes referred to as a two-way mirror. The mirror 12 isconfigured transmit a first portion of light that is incident on itssurfaces to the other side of the mirror 12, and to reflect a secondportion of the light that is incident on its surfaces. This may beaccomplished by applying a thin layer of a partially reflective coatingto a generally transparent substrate material, such that less than allof the incident light is reflected by the partially reflecting coating.The remaining light is transmitted through the mirror 12 to the otherside. Similarly, some light that strikes the mirror 12 on a sideopposite the side where a user is standing will be transmitted throughthe mirror 12, allowing the user to see that transmitted light. Thispartially reflective coating can generally be applied to surface of thesubstrate material on the display-side of the substrate material, theuser-side of the substrate material, or both. Thus, the partiallyreflective coating can be present on the surface of one or both of thedisplay-side and the user-side of the mirror 12. In someimplementations, the partially reflective coating is made of silver. Thegenerally transparent material can be glass, acrylic, or any othersuitable material. The mirror 12 can have a rectangular shape, an ovalshape, a circle shape, a square shape, a triangle shape, or any othersuitable shape. The processor 22 is communicatively coupled with theelectronic display 14, the one or more sensors 16, the one or more lightsources 18, and the one or more cameras 20.

Referring now to FIG. 2, the mirror 12 can be mounted on a base 26. Themirror could also be directly mounted in a counter, a wall, or any otherstructure. The electronic display 14 is mounted on, coupled to, orotherwise disposed on a first side of the mirror 12, while a sensorframe 28 containing the one or more sensors 16 is disposed at anopposing second side of the mirror 12. The side of the mirror 12 wherethe display 14 is located is generally referred to as the display-sideof the mirror 12. The side of the mirror 12 where the sensor frame 28 islocated is generally referred to as the user-side of the mirror 12, asthis is the side of the mirror 12 where the user will be located duringoperation.

The electronic display 14 is generally mounted in close proximity to thesurface of the display-side of the mirror 12. The electronic display 14can be any suitable device, such as an LCD screen, an LED screen, aplasma display, an OLED display, a CRT display, or the like. Due to thepartially reflective nature of the mirror 12, when the display 14 isactivated (e.g. turned on and emitting light to display an image), auser standing on the user-side of the mirror 12 is able to view anyportion of the display 14 that is emitting light through the mirror 12.When the display 14 is turned off, light that is incident on theuser-side of the mirror 12 from the surroundings will be partiallyreflected and partially transmitted. Because the display 14 is off,there is no light being transmitted through the mirror 12 to theuser-side of the mirror 12 from the display-side. Thus, the userstanding in front of the mirror 12 will see their reflection due tolight that is incident on the user-side of the mirror 12 and isreflected off of the mirror 12 back at the user. When the display 14 isactivated, a portion of the light produced by the display 14 that isincident on the mirror 12 from the display-side is transmitted throughthe mirror 12 to the user-side. The mirror 12 and the display 14 aregenerally configured such that the intensity of the light that istransmitted through the mirror 12 from the display 14 at any given pointis greater than the intensity of any light that is reflected off of thatpoint of the mirror 12 from the user-side. Thus, a user viewing themirror 12 will be able to view the portions of the display 14 that areemitting light, but will not see their reflection in the portions ofthose mirror 12 through which the display light is being transmitted.

The electronic display 14 can also be used to illuminate the user orother objects that are located on the user-side of the mirror 12. Theprocessor 22 can activate a segment of the display 14 that generallyaligns with the location of the object relative to the mirror 12. In animplementation, this segment of the display 14 is activated responsiveto one of the one or more sensors 16 detecting the object and itslocation on the user-side of the mirror 12. The segment of the display14 can have a ring-shaped configuration which includes an activatedsegment of the display 14 surrounding a non-activated segment of thedisplay 14. The non-activated segment of the display 14 could beconfigured such that no light is emitted, or could be configured suchthat some light is emitted by the display in the non-activated segment,but it is too weak or too low in intensity to be seen by the userthrough the mirror 12. In an implementation, the activated segment ofthe display 14 generally aligns with an outer periphery of the object,while the non-activated segment of the display 14 generally aligns withthe object itself. Thus, when the object is a user's face, the user willbe able to view the activated segment of the display 14 as a ring oflight surrounding their face. The non-activated segment of the display14 will align with the user's face, such that the user will be able tosee the reflection of their face within the ring of light transmittedthrough the mirror. In another implementation, the non-activated segmentof the display aligns with the object, and the entire remainder of thedisplay 14 is the activated segment. In this implementation, the entiredisplay 14 is activated except for the segment of the display 14 thataligns with the object.

Generally, the system 10 includes one or more sensors 16 disposed in thesensor frame 28. The sensor frame 28 is mounted on, couple to, orotherwise disposed at the second side (user-side) of the mirror 12. Thesensors 16 are generally located within a range of less than about fiveinches from the user-side surface of the mirror 12. In otherimplementations, the sensors 16 could be disposed between further awayfrom the surface of the mirror 12, such as about between about 5 inchesand about 10 inches. The sensors 16 are configured to detect thepresence of a hand, finger, face, or other body part of the user whenthe user is within a threshold distance from the mirror 12. Thisthreshold distance is the distance that the sensors 16 are located awayfrom the user-side surface of the mirror 12. The sensors 16 arecommunicatively coupled to the processor 22 and/or memory 24. When thesensors 16 detect the presence of the user aligned with a certain pointof the mirror 12 (and thus the display 14), the processor 22 isconfigured to cause the display 14 to react as if the user had touchedor clicked the display 14 at a location on the display 14 correspondingto the point of the mirror 12. Thus, the sensors 16 are able totransform the mirror/display combination into a touch-sensitive display,where the user can interact with and manipulate applications executingon the display 14 by touching the mirror 12, or even bringing theirfingers, hands, face, or other body part in close proximity to theuser-side surface of the mirror 12. In some implementations, the sensors16 can include a microphone that records the user's voice. The data fromthe microphone can be sent to the processor 22 to allow the user tointeract with the system using their voice.

The one or more sensors 16 are generally infrared sensors, althoughsensors utilizing electromagnetic radiation in other portions of theelectromagnetic spectrum could also be utilized. The sensor frame 28 canhave a rectangular shape, an oval shape, a circular shape, a squareshape, a triangle shape, or any other suitable shape. In animplementation, the shape of the sensor frame 28 is selected to matchthe shape of the mirror 12. For example, both the mirror 12 and thesensor frame 28 can have rectangular shapes. In another implementation,the sensor frame 28 and the mirror 12 have different shapes. In animplementation, the sensor frame 28 is approximately the same size asthe mirror 12 and generally is aligned with a periphery of the mirror12. In another implementation, the sensor frame 28 is smaller than themirror 12, and is generally aligned with an area of the mirror 12located interior to the periphery of the mirror 12. In a furtherimplementation, the sensor frame 28 could be larger than the mirror 12.

In an implementation, the mirror 12 generally has a first axis and asecond axis. The one or more sensors 16 are configured to detect a firstaxial position of an object interacting with the sensors 16 relative tothe first axis of the mirror 12, and a second axial position of theobject interacting with the sensors relative to the second axis of themirror 12. In an implementation, the first axis is a vertical axis andthe second axis is a horizontal axis. Thus, in viewing the sensor frame28 from the perspective of the user, the sensor frame 28 may have afirst vertical portion 28A and an opposing second vertical portion 28B,and a first horizontal portion 28C and an opposing second horizontalportion 28D. The first vertical portion 28A has one or more infraredtransmitters disposed therein, and the second vertical portion 28B hasone or more corresponding infrared receivers disposed therein. Eachindividual transmitter emits a beam of infrared light that is receivedby its corresponding individual receiver. When the user places a fingerin close proximity to the mirror 12, the user's finger can interruptthis beam of infrared light such that the receiver does not detect thebeam of infrared light. This tells the processor 22 that the user hasplaced a finger somewhere in between that transmitter/receiver pair. Inan implementation, a plurality of transmitters is disposedintermittently along the length of the first vertical portion 28A, whilea corresponding plurality of receivers is disposed intermittently alongthe length of the second vertical portion 28B. Depending on whichtransmitter/receiver pairs detect the presence of the user's finger (orother body part), the processor 22 can determine the vertical positionof the user's finger relative to the display 14. The first axis andsecond axis of the mirror 12 could be for a rectangular-shaped mirror, asquare-shaped mirror, an oval-shaped mirror, a circle-shaped mirror, atriangular-shaped mirror, or any other shape of mirror.

The sensor frame 28 similarly has one or more infrared transmittersdisposed intermittently along the length of the first horizontal portion28C, and a corresponding number of infrared receivers disposedintermittently along the length of the second horizontal portion 28D.These transmitter/receiver pairs act in a similar fashion as to the onesdisposed along the vertical portions 28A, 28B of the sensor frame 28,and are used to detect the presence of the user's finger and thehorizontal location of the user's finger relative to the display 14. Theone or more sensors 16 thus form a two-dimensional grid parallel withthe user-side surface of the mirror 12 with which the user can interact,and where the system 10 can detect such interaction.

In other implementations, the sensor frame 28 may include one or moreproximity sensors, which can be, for example, time of flight sensors.Time of flight sensors do not rely on separate transmitters andreceivers, but instead measure how long it takes an emitted signal toreflect off on an object back to its source. A plurality of proximitysensors on one edge of the sensor frame 28 can thus be used to determineboth the vertical and horizontal positions of an object, such as theuser's hand, finger, face, etc. For example, a column of proximitysensors on either the left or right edge can determine the verticalposition of the object by determining which proximity sensor wasactivated, and can determine the horizontal position by using thatproximity sensor to measure how far away the object is from theproximity sensor. Similarly, a row of proximity sensors on either thetop or bottom edge can determine the horizontal position of the objectby determining which proximity sensor was activated, and can determinethe vertical position by using that proximity sensor to measure how faraway the object is from the proximity sensor.

The sensors in the sensor frame 28 (whether IR transmitter/receiverpairs or proximity sensors) can be used by the system to determinedifferent types of interactions between the user and the system. Forexample, the system can determine whether the using is swipinghorizontally (left/right), vertically (up/down), or diagonally (acombination of left/right and up/down). The system can also detect whenthe user simply taps somewhere instead of swiping. In someimplementations, the sensor frame 28 is configured to detectinteractions between the user and the system when the user is betweenabout 3 centimeters and about 15 centimeters from the surface of themirror.

The system 10 further includes one or more light sources 18. In animplementation, the light sources 18 are light emitting diodes (LEDs)having variable color and intensity values that can be controlled by theprocessor 22. In other implementations, the light sources 18 can beincandescent light bulbs, halogen light bulbs, fluorescent light bulbs,black lights, discharge lamps, or any other suitable light source. Thelight sources 18 can be coupled to or disposed within the base 26 of thesystem 10, or they can be coupled to or disposed within the sensor frame28. For example, while FIG. 2 only shows two light sources 18 disposedin a bottom portion of the system 10, a plurality of light sources 18could be disposed about the frame such that the light sources 18generally surround the mirror. In some implementations, the lightsources 18 may be disposed on either the user-side of the mirror 12 orthe display-side of the mirror 12. When disposed on the user-side of themirror 12, the light emitted by the light sources 18 is configured totravel through the mirror 12 towards the user. The light sources 18 canalso be rotationally or translationally coupled to the sensor frame 28or other parts of the system 10 such that the light sources 18 can bephysically adjusted by the user and emit light in different directions.The light sources 18 could also be disposed in individual housingsseparate from the mirror/display combination. The light sources 18 areconfigured to produce light that is generally directed outward away fromthe mirror 12 and toward the user. The light produced by the one or morelight sources 18 can thus be used to illuminate the user (or any otherobject disposed on the user-side of the mirror). Because they arevariable in color and intensity, the light sources 18 can thus be usedto adjust the ambient light conditions surrounding the user.

The system 10 also includes one or more cameras 20 mounted on or coupledto the mirror 12. The cameras 20 could be optical cameras operatingusing visible light, infrared (IR) cameras, three-dimensional (depth)cameras, or any other suitable type of camera. The one or more cameras20 are disposed on the display-side of the mirror 12. In animplementation, the one or more cameras 20 are located above theelectronic display 14, but are still behind the mirror 12 from theperspective of the user. The lenses of the one or more cameras 20 facestoward the mirror 12 and are thus configured to monitor the user-side ofthe mirror 12. In an implementation, the one or more cameras 20 monitorthe user-side of the mirror 12 through the partially reflective coatingon the mirror 12. In another implementation, the one or more cameras 20are disposed at locations of the mirror 12 where no partially reflectivecoating exists, and thus the one or more cameras 20 monitor theuser-side of the mirror 12 through the remaining transparent material ofthe mirror 12. The one or more cameras 20 may be stationary, or they maybe configured to tilt side-to-side and up and down. The cameras 20 canalso be moveably mounted on a track and be configured to moveside-to-side and up and down. The one or more cameras 20 are configuredto capture still images or video images of the user-side of the mirror12. The display 14 can display real-time or stored still images or videoimages captured by the one or more cameras 20.

The one or more cameras 20 are communicatively coupled to the processor22. The processor 22, using the still or video images captured by theone or more cameras 20, can detect and identify a variety of objectsusing computer vision. The processor 22 can be configured to modify theexecution of an application being executing by the processor 22, such asautomatically launching a new application or taking a certain action inan existing application, based on the object that is detected andidentified by the cameras 20 and the processor 22. For example,following the detection of an object in the user's hand and theidentification of that object as a toothbrush, the processor 22 can beconfigured to automatically launch a tooth-brushing application to runon the display 14, or launch a tooth brushing feature in the currentapplication. The processor 22 can be configured to automatically launchan application to assist the user in shaving upon detecting andidentifying a razor, or an application to assist the user in applyingmakeup upon detecting and identifying any sort of makeup implement, suchas lipstick, eye shadow, etc. The one or more cameras 20 can alsorecognize faces of users and differentiate between multiple users. Forexample, the camera 20 may recognize the person standing in front of themirror 12 and execute an application that is specific to that user. Forexample, the application could display stored data for that user, orshow real-time data that is relevant to the user.

In an implementation, the processor 22 can be configured to execute afirst application while the display 14 displays a first type ofinformation related to the first application. Responsive to theidentification of the object by the system 10, the processor isconfigured to cause the display 14 to display a second type ofinformation related to the first application, the second type ofinformation being (i) different from the first type of information and(ii) based on the identified object. In another implementation,responsive to the identification of the object, the processor isconfigured to execute a second application different from the firstapplication, the second application being based on the identifiedobject.

FIG. 3A illustrates a front elevation view of the system 10, while FIG.3B illustrates a side elevation view of the system 10. As can be seen inFIG. 3A, the sensor frame 28 surrounds the mirror 12, while portions ofthe display 14 that are activated are visible through the mirror 12.FIG. 3A also shows the two-dimensional grid that can be formed by thesensors 16 in the sensor frame 28 that is used to detect the user'sfinger, head, or other body part. This two-dimensional grid is generallynot visible to the user during operation. FIG. 3B shows the arrangementof the sensor frame 28 with the sensors 16, the mirror 12, the display14, and the camera. In an implementation, the processor 22 and thememory 24 can be mounted behind the display 14. In otherimplementations, the processor 22 and the memory 24 may be located atother portions within the system 10, or can be located external to thesystem 10 entirely. The system 10 generally also includes housingcomponents 43A, 43B that form a housing that contains and protects thedisplay 14, the camera, and the processor 22.

FIG. 4A and FIG. 4B illustrate the system 10's ability to allow a user30 to view their reflection 32 in the mirror 12, and to view activatedsegments of the display 14 behind the mirror 12. FIG. 4A and FIG. 4Balso illustrate the system 10's ability to illuminate an object (such asthe user's face) with the display 14. In FIG. 4A, a large segment of thedisplay 14 is not activated, e.g. the display is off, is showing a blackscreen, or is otherwise emitting light that cannot be seen by the userthrough the mirror 12. Because the user cannot see any light emittedfrom the display 14 in the large segment, the only light that reachesthe user 30's eyes is light that is incident on the user-side of themirror 12 and is reflected back to the user 30. Thus, the user 30 sees areflection 32 of themselves and their surroundings due to the lightreflected off of the user-side surface of the mirror 12. Only in thesmall segments at the top and bottom of the display 14 where the display14 is activated is the user 30 not able to see the reflection 32, andinstead sees the display 14.

In FIG. 4B, a segment in the center of the display 14 on thedisplay-side of the mirror 12 has been activated and is directing lighttoward the mirror 12. In the implementation shown in FIG. 4B, theactivated segment of the display 14 has a ring-shaped configuration, andthus the display 14 shows a ring of light 34. The light emitted from thedisplay 14 is transmitted through the mirror 12 to the user-side of themirror 12, and thus the emitted right of light is visible to the user30. As can be seen, the light that is transmitted through the mirror 12at a given point on the mirror 12 is stronger than the light that isreflected off of the user-side surface of the mirror 12 at that point.At those points of the mirror 12, the user 30 only sees the display 14through the mirror 12, rather than their reflection 32 in the mirror 12.In FIG. 4B, the ring of light is transmitted through the mirror 12 suchthat it generally surrounds the user 30's face. As is shown in thefigure, the user 30's reflection 32 in the mirror 12 is interrupted bythe ring of light 34 transmitted through the mirror 12 from the display14. The ring of light 34 can be used to illuminate a face of the user30. Thus, the activated segment of the display is generally aligned withthe periphery of the user's face, while an enclosed non-activatedsegment of the display is generally aligned with the user's face itself,allowing the user to see the reflection of his face.

A method 500 of illuminating the face of a user is illustrated in FIG.5A. At step 502, the one or more sensors 16 of the system 10 areactivated. At step 504, the one or more sensors 16 monitor the area infront of the user-side surface of the mirror 12. The one or more sensors16 are configured to detect any portion of the user, such as the user'sfingers or face, that the user places within a threshold distance of themirror 12. In an implementation, this threshold distance is less thanabout five inches, between about 0.1 and four inches, between about 1and about 3 inches, or less than about 2 inches. The threshold distancecould also be greater than about 5 inches. At step 506, the one or moresensors 16 detect a plurality of different points of interaction betweenthe user and the two-dimension grid defined by the sensors 16. Theseinteractions are indicative of the user placing his or her face withinthe threshold distance from the user-side surface of the mirror 12. Theone or more sensors 16 recognize that the user has placed their face upto the mirror 12 rather than a single finger by detecting multipleinteractions between the user and the two-dimensional grid defined bythe one or more sensors 16. In an implementation, if the one or moresensors 16 detect five points of contact, and that the five points ofcontact are within less than about 60 square inches, the system 10interprets this as the user placing their face within the thresholddistance from the user-side surface of the mirror 12.

At step 508, the system 10 determines the outline of the user's facefrom the detected points of interaction with the sensors 16. The system10 determines the outer boundary that is defined by all of the points ofinteraction between the user's face and the sensors 16 and uses thisboundary as an estimate of the outline of the user's face. At step 510,the electronic display 14 is activated to outline the user's face with aring of light. Generally, the display 14 at this step will show a blackscreen except for the ring of light, which generally corresponds to theouter boundary of the user's face as detected by the one or more sensors16. The display 14 could also show a variety of other minor components,such as the time or other icons. Thus, the user looking at the surfaceof the mirror 12 will see their reflection, and will also see a ring oflight that is being transmitted through the mirror 12 from the display14. This ring of light generally surrounds the reflection of the user'sface in the mirror 12 and illuminates the user's actual face. Theillumination can assist the user in any activity they are about topartake in, such as shaving, brushing their teeth, applying makeup, etc.The system 10 can also track the user's face in real-time and thusconstantly update the position of the displayed ring of light. Thisallows the user to move their face around while still having their faceilluminated at all times by the display 14.

An implementation of what is displayed on the electronic display 14during method 500 is illustrated in FIG. 6A and FIG. 6B. In FIG. 6A, thedisplay 14 primarily shows a black screen. The display 14 can also showother features, such as the time 36, or a lighting icon 38. The lightingicon 38 can show the current state of the light that is being emitted bythe light sources 18, the current conditions of the ambient light, orboth. The lighting icon 38 may also be interactive to allow the user toadjust the light being emitted by the light sources 18. In FIG. 6B, thesystem 10 has detected and illuminated the user's face by displaying aring of light 34 on the display 14. As can be seen, the display 14 inthis state includes an activated segment in a ring-shaped configurationsubstantially surrounding a non-activated segment, such that thenon-activated segment is located in the interior of the ring of light34. This allows the user to see his or her own reflection in the mirror12 without any interference from the display 14. The ring of light 34 isdisplayed on the display 14 at a location that generally correspondswith the periphery of the user's face. This ring of light 34 istransmitted through the display 14 and is generally incident upon theuser's face, thus illuminating the user's face.

A method 700 of detecting and identifying an object and modifying anapplication being executed by the processor 22 is illustrated in FIG. 7.At step 702, the one or more cameras 20 of the system 10 are activated.At this step, the processor 22 of the system 10 will be executing anapplication and displaying information related to that application onthe display 14. The application could be a specific program installed inthe memory 24 of the processor 22, or could even simply be a basicoperating system. At step 704, the one or more cameras 20 monitor thearea on the user-side of the mirror 12 for the user and any objects theymay be holding. In an implementation, the images recorded by the camera20 could be displayed in real-time on the display 14. At step 706, theprocessor 22 receives images from the one or more cameras 20 and detectsthat the user is holding an object. At step 708, the processor 22identifies the object the user is holding from one of a predeterminednumber of objects that the processor 22 can recognize. The processor 22of the system 10 can be programmed with computer vision algorithms thatare configured to detect and identify objects that the user is holding.For example, the system 10 may be configured to detect when the user isholding a toothbrush, a razor, a comb, a makeup implement such aslipstick or eye shadow, a curling iron, a hair straightener, a blowdryer, or any other object that the user may commonly be holding whilein front of the mirror 12. In some implementations, the user can trainthe system 10 to identify different objects. For example, the system 10may request that the user hold up a specific object, for example atoothbrush. The system can then be trained to identify the toothbrushand any characteristics specific to the toothbrush. In this manner, thesystem 10 can be trained to improve its recognition of a variety ofdifferent objects.

At step 710, responsive to and based on the identification of the objectthe user is holding, the processor 22 modifies the execution of theapplication. In an implementation, the modification of the execution ofthe application includes displaying different information on the display14 from what was display prior to the identification of the object. Inanother implementation, the modification of the execution of theapplication includes executing a new application that is different fromthe application that was being executed prior to the identification ofthe object.

For example, if the system 10 identifies the object that the user isholding as a toothbrush, the system 10 can launch a tooth brushingapplication design to assist people in brushing their teeth. The system10 can also start a tooth brushing feature in the currently runningapplication. If the system 10 identifies a razor, the system 10 maylaunch a shaving application or shaving feature in thecurrently-executing application to assist the user in shaving theirface. If the system 10 identifies any type of makeup implement, thesystem 10 could launch a makeup tutorial based on the type and color ofmakeup that the user is holding. Furthermore, in addition to the use ofthe sensors 16 described above with respect to detecting andilluminating the user's face, the one or more cameras 20 can also beconfigured to recognize the user's face and/or identify, and take apredetermined action based on this recognition. This action could beilluminating the user's face as described above, or could be some otheraction.

In other implementations, the system 10 may identify the object byscanning a product barcode on the object or the object's packaging, orby detecting an RFID tag that is part of or coupled to the object or theobject's packaging. To scan the barcode, the system 10 can include abarcode scanner, or the camera 20 of the system 10 can be configured toscan the barcode. To detect the RFID tag, the system 10 will generallyinclude an RFID reader that is configured to detect and read the RFIDtag when the product is near the system 10.

In some implementations, the system 10 can request the user to confirmthe system 10's identification of an object. For example, the system 10may cause the display 14 to display the name of the object, along with“Yes” and “No” indicators. The user can select one of the indicators toindicate to the system 10 whether the object has been identifiedcorrectly. In other implementations, the user can say “Yes” or “No” outloud, which can be detected by the microphone. The data from themicrophone can be sent to the processor to allow the user to confirmwhether the system 10 has correctly identified the object.

A method of compensating for ambient lighting conditions is illustratedin FIG. 8. Generally, the system 10 is able to recognize and compensatefor the ambient lighting conditions of the area where the user and thesystem 10 are located, so as to illuminate the user with a desired setof lighting conditions. At step 802, the system 10 monitors and detectsambient lighting conditions. In an implementation, the monitoring anddetecting of the ambient lighting conditions is done by the one or morecameras 20. In another implementation, the system 10 includes a separateoptical sensor that is specifically configured to monitor and detectambient lighting conditions. The ambient lighting conditions can bedetermined from sensing the color or hue of an object in the field ofview of the camera/optical sensor with known reflectance properties. Thesystem 10 could also detect the ambient lighting conditions by capturingan image of the user's face and analyzing the captured image todetermine the currently ambient lighting conditions. Further, the system10 could detect ambient lighting conditions by using an optical sensorto collect and analyze ambient light. The system 10 could also use anycombination of the above, or other methods, to detect the ambient lightconditions.

At step 804, the difference between the detected ambient lightingconditions and the desired ambient lighting conditions is determined.The difference can be measured in terms of color temperature/whitebalance. The desired ambient lighting conditions can be manually inputby the user, or the user could also select from one of a plurality ofpre-determined desired ambient lighting conditions. In anotherimplementation, the user could use a sensor or other device to measurethe ambient lighting conditions at a desired location, for example theuser's office, and then upload this measurement to the system 10. Thesystem 10 could then compare the detected ambient lighting conditions tothe uploaded ambient lighting conditions. The uploaded ambient lightingconditions could be in the form of simple numerical data, but could alsocomprise an image of the desired location with desired lightingconditions. At step 806, the system 10 adjusts the color, intensity, andother parameters of the one or more light sources 18 to compensate forthe detected ambient light conditions and produce the desired lightingconditions. This desired lighting condition can be achieved causing theone or more light sources 18 to emit various shades and intensities ofwhite light. The desired lighting conditions could also be achieved bycausing the one or more light sources 18 to emit different colors oflight, such as but not limited to red, green, blue, purple, yellow,orange, etc. The illumination of the object due to the ambient lightingconditions and the illumination of the object due to the light producedby the one or more light sources 18 combine to cause the object to beilluminated by the desired lighting condition.

In some implementations, the system 10 continually detects the ambientlighting conditions, adjusts the light being emitted from the lightsources 18, newly detects the ambient lighting conditions, and thenreadjusts the light being emitted from the light sources. The system 10can also use the detected ambient lighting conditions to calibrateitself, such that each time the system 10 is activated by the user, thesystem 10 will automatically adjust the light sources 18 to bring aboutthe desired ambient lighting conditions. The system 10 can also allowthe user to monitor the process and view the updated lightingconditions, either by the user's reflection in the mirror 12, or bydisplaying a live feed from the one or more cameras 20 on the display14. The user can also manually adjust the light being emitted from theone or more light sources 18 depending on his or her preferences.

A method 900 of capturing an image of the user is illustrated in FIG. 9.At step 902, the one or more cameras 20 are activated and beginmonitoring the area on the user-side of the mirror 12. At step 904, areal-time image of the user's face is shown on the display 14 in an areaof the display 14 that generally aligns with the user's face. The userthus sees the real-time image of themselves from the one or more cameras20, rather than their reflection. At step 906, one or moreuser-selectable icons are displayed on the display 14. Each of theuser-selectable icons corresponds to a different ambient lightingcondition, such as natural light, no light, soft light, sunset, sunrise,rainbow colors, or other desired ambient lighting conditions. At step908, the system 10 detects user input that corresponds to a selection ofone of the user-selectable icons. At step 910, the system 10 adjusts thecolor, intensity, or other parameter of the light emitted by the one ormore light sources 18 so as to illuminate the user with the desiredambient lighting condition. At step 912, an image of the user's faceand/or other portions of the user is captured.

In another implementation, the system 10 recognizes the user's face whenthe user steps into the field of view of the one or more cameras 20.Instead of displaying user-selectable icons, the system 10 automaticallyselects a pre-determined lighting profile based on which user the system10 has recognized. For example, a certain user may prefer to captureimages of themselves using the system 10 in soft light, and thus canconfigure the system 10 to automatically illuminate their face in softlight. The capture of the image can be manually triggered by the user,or can be automatic once the desired lighting conditions have beenachieved. The system 10 can also give a countdown to the user so theycan be prepared for the image to be captured.

An implementation of what is displayed on the electronic display 14during method 900 is illustrated in FIG. 10. In FIG. 10, the display 14shows a plurality of icons 40A, 40B, 40C, each corresponding to adifferent ambient light condition that the user may select. Icon 40Acorresponds to no light. Icon 40B corresponds to natural light. Icon 40Ccorresponds to soft light. The user can select any of these icons tocause the processor to adjust the light produced by the light sourcessuch that the ambient light conditions in the area surrounding the usercorrespond to the selected icon. The display 14 can also display thetime 36, or a lighting icon 38 that indicates the lighting conditionsand can allow the user to adjust them. In an implementation, the displaycan show instructions to the users. In another implementation, thedisplay shows a real-time image of the user captured by the camera.

Referring now to FIG. 11A, an implementation of the system 10 includes afirst display 14A and a second display 14B. The first display 14A andthe second display 14B are both located on a side of the mirror 12opposite where a user would be located. The first display 14A and thesecond display 14B are generally spaced apart such that a gap is definedbetween them. The system 10 further includes one or more cameras 20 thatare located on the same side of the mirror 12 as the first display 14Aand the second display 14B. However, the one or more cameras 20 arelocated in the gap between the first display 14A and the second display14B, rather than being up near the top of the mirror 12. The system 10will generally include a sensor frame including one or more sensor, andone or more light sources. The system 10 thus operates in generally thesame manner as other implementations disclosed herein. However, bylocating the one or more cameras 20 between the first display 14A andthe second display 14B, the one or more cameras 20 will generally bepositioned level with a user's face, and can thus obtain images of theuser at a more appropriate viewing angle.

FIG. 11B illustrates an implementation of the system 10 that includestwo displays 14A and 15B, and two cameras 20A and 20B. As shown, thisimplementation of the system 10 includes a left camera 20A and a rightcamera 20B. The field of view of the left camera 20A generally spansfrom the center of the user's face to the far left boundary of theuser's face (e.g., the outer edge of the user's left ear) so as tocapture an image or a video of the left side of the user's face.Similarly, the field of view of the right camera 20B generally spansfrom the center of the user's face to the far right boundary of theuser's face (e.g., the outer edge of the user's right ear) so as tocapture an image or a video of the right side of the user's face. Theimages and/or videos from the two cameras 20A, 20B can be combined toform a single front-facing image of the user's face. In someimplementations, there is a slight overlap in the fields of view of thetwo cameras 20A, 20B near the center of the user's face to ensure all ofthe user's face is captured by at least one of the cameras 20A, 20B.

FIG. 12 illustrates an implementation of the system 10 where the mirror12 and the sensor frame 28 have different shapes. In thisimplementation, the mirror 12 is oval-shaped while the sensor frame 28is rectangular-shaped. FIG. 13 illustrates an implementation of thesystem 10 where the mirror 12 and the sensor frame 28 have the sameshapes but different sizes. Both the mirror 12 and the sensor frame 28are rectangular-shaped, but the mirror 12 is larger than the sensorframe 28. In this implementation, the sensor frame 28 is generallyaligned with an area of the mirror 12 interior to the periphery of themirror 12.

Other implementations of the smart mirror system are contemplated inaccordance with the present disclosure. For example, the system couldoperate without the mirror. The images captured by the camera could bedisplayed on the display device to take the place of the reflection inthe mirror. The system can also connect to a multitude of other devices,such as mobile phones, laptop computers, desktop computers, onlineservers, fitness trackers, Internet-connected scales, cloud services,Internet-connected water bottles, Internet-connected thermostats, orother devices. The system can aggregate all of the data collected fromany devices connected to the system and provide an easy-accessiblelocation for the user to view the data. The system can also analyze allof the data and correlate different events, and then offer advice to theuser. For example, the system can obtain data from the user'sInternet-connected scale showing that the user lost weight in a giventime period. The system can analyze data from other connected devicescollected during that time period to determine what other activities orevents the user experienced that may have contributed to the weightloss. For example, the system may recognize that during the time periodthat the user lost weight, the user also drank a certain amount ofwater, slept a certain number of hours per day, and underwent a certainamount of activity day. The system can correlate all of this data,present it to the user, and offer advice on what may have led to theuser's weight loss.

In an implementation, the system can monitor features on their body orface, such as moles, wrinkles, or beauty spots. The system captures aninitial image of the user using the camera. The user can view thecaptured image and select one or more features for the system tomonitor. Once the feature is selected by the user the system, usingimage processing and/or computer vision algorithms, can allow a finerselection or delineation of the feature selected by the user. In anotherimplementation, the system can mark features without user selection.Once the features are selected and marked by the system, the initiallocation, color, and other characteristics of the selected features arestored in the memory of the system. The system can capture subsequentimages of the user and identify the selected features. Any deviation inthe characteristics of the features can be monitored by the system. Anyunusual deviations can be reported by the system to the user. In someimplementations, the system can monitor features such as moles, growths,sores, or other features that can appear on the user's skin that may beindicative of skin cancer or other diseases. The system can monitorfeatures by looking at images of only the feature itself, or can monitorthe features by analyzing images of the user's entire face and/or body.The system can also monitor other features indicative of medicalconditions or diseases. For example, the system can monitor the user'shair to determine if any of the user's hair is falling out. The systemcan also monitor the user's teeth, gums, or lips for any indication ofcavities, gum diseases, or other afflictions. The user's eyes can alsobe monitored for any type of distinguishing feature.

Referring now to FIG. 14, in some implementations of the system, themirror 12 includes an inner zone 13 and two outer zones 15A and 15B. Theinner zone 13 defines the area on either surface of the mirror 12 (orboth) that includes the partially reflective coating. The outer zones15A and 15B define the area on both surfaces of the mirror 12 where nopartially reflective coating exists. In some implementations, the outerzones 15A and 15B are formed as generally vertical bands or strips. Inthese areas, the mirror 12 comprises only the generally transparentsubstrate material (e.g., glass, acrylic, etc.). In someimplementations, one or more light sources (such as light sources 18discussed herein) can be positioned on the display-side of the mirror12. The light sources are positioned such that they emit light towardsthe mirror 12, which propagates through the generally transparentsubstrate material and then to the user. The light sources can thusshine light through the generally transparent substrate material of themirror 12 to illuminate the user, the area or objects surrounding theuser, or both.

In some implementations, one or both of the display-side surface of themirror 12 and the user-side surface of the mirror 12 within the outerzones 15A and 15 can be sandblasted. Because the partially reflectivecoating is not present on either surface of the generally transparentsubstrate material within the outer zones 15A and 15B, the generallytransparent substrate material itself is sandblasted. By sandblastingthe surface of the substrate material, the light emitted toward the userby the light sources is diffused as it travels through the substratematerial. By diffusing the light that is emitted through the mirror 12towards the user, the system 10 achieves a more even illumination of theuser and the area/objects surrounding the user. Further, if the outerzones 15A and 15B were both sandblasted and contained the partiallyreflective coating, the resulting light transmitted by the light sourcestowards the user would generally be dull and not provide sufficientillumination. Thus, the outer zones 15A and 15B are generally onlysandblasted. However, in certain implementations, the outer zones 15Aand 15B, or the inner zone 13, may be sandblasted and include thepartially reflective coating.

In one implementation, the partially reflective coating is present onlyon the surface of the user-side of the substrate material within theinner zone 13, while the substrate material is sandblasted only on thedisplay-side within the outer zones 15A and 15B. By coating only theuser-side surface of the substrate material with the partiallytransparent coating, images designed to be shown to the user through themirror 12 by the displays on the display-side of the mirror 12 are morevisible. Further, if the user-side surface of the substrate materialwithin the outer zones 15A and 15B is sandblasted, the resulting poroussurface can more easily absorb liquids or other substances such asshaving cream, toothpaste, etc. By only sandblasting the display-side ofthe substrate material, the user-side of the substrate material withinthe outer zones 15A and 15B will generally not absorb undesirablesubstances. The partially reflective coating is not present on theuser-side surface of the substrate material within the outer zones 15Aand 15B so as to not dull the light that is emitted by the light sourcesand transmitted through the mirror 12.

In another implementation, the partially reflective coating is presentonly on the surface of the display-side of the substrate material withinthe inner zone 13, while the substrate material is sandblasted only onthe user-side within the outer zones 15A and 15B. In otherimplementations, the partially reflective coating is present on the sameside of the substrate material that is sandblasted. In theseimplementations, either or both of the user-side and the display-side ofthe substrate material is coated by the partially reflective coatingwithin the inner zone 13. The outer zones 15A and 15B of that same sideof the substrate material is sandblasted. In some implementations, thepartially reflective coating is deposited on the entirety of the desiredsurface(s) of the substrate material, including in the inner zone 13 andin the outer zones 15A and 15B. The partially reflective coating withinthe outer zones 15A and 15B can then be removed, either by thesandblasting process or by another process preceding the sandblastingprocess. In still other implementations, the partially reflectivecoating is deposited on the desired surface(s) only within the innerzone 13.

Referring now to FIG. 15, the system 10 can include an obstruction 100that is configured to at least partially block or obscure the field ofview of the camera 20. This allows the user to prevent him or herselffrom being viewed by the camera 20, and also prevents the camera 20 fromviewing the area surrounding the user. In some implementations, the usercan manually move the obstruction 100 between a stored position and adeployed position. In other implementations, the obstruction 100 can bemoved between the stored position and the deployed position using one ormore electronic actuation devices, which can include a solenoid, aspring, a lever, a magnet, any combination thereof, or any othersuitable device. FIG. 15 illustrates the obstruction 100 in the deployedposition. In other implementations, the processor(s) of the system 10are configured to move the obstruction 100 between the stored positionand the deployed position. As shown in the implementation of FIG. 15,the obstruction 100 can be mounted to the underside of the top portionof the frame, and includes a portion projecting downwardly that blocksthe field of view of the camera 20. In some implementations, theobstruction 100 is pivotally coupled to the frame. In otherimplementations, the obstruction 100 is slidably or translatably coupledto the frame.

FIGS. 16A and 16B show perspective views of the top and bottom of theobstruction 100. As shown, the obstruction 100 generally includes abaseplate 102 and a projection portion 104. The baseplate 102 includes avariety of fastener apertures 106A-106H that are used to secure theobstruction 100 to the frame (or another component) of the system. Insome implementations, respective fasteners extend through the fastenerapertures 106A-106H and into the frame to secure the obstruction 100 tothe frame. The fasteners can be screws, nails, pins, rods, clips, etc.In other implementations, the obstruction 100 can be secured to theframe without the use of fasteners and the fastener apertures 106A-106H,for example by using adhesive.

The projection portion 104 is coupled to the baseplate 102 in a mannerthat allows the projection portion 104 to move between a stored positionand a deployed position. FIGS. 16A and 16B show the projection portion104 in the deployed position. In this deployed position, the projectionportion 104 extends away from the baseplate 102 so as to block the fieldof view of the camera 18. In some implementations, the projectionportion 104 is pivotally coupled to the baseplate 102 via a hinge orother structure that allows the projection portion 104 to pivot relativeto the baseplate 102. In still other implementations, the projectionportion 104 is configured to move generally along one dimension betweenthe stored position and the deployed position. The baseplate 102 caninclude a depression 108 defined therein that is sized to accommodatethe projection portion 104 when the projection portion 104 is moved tothe stored position. The projection portion 104 and the depression 108can be sized so that the obstruction 100 has a generally flat surfacewhen the projection portion 104 is in the stored position.

In some implementations, the projection portion 104 can be biasedtowards either the stored position or the deployed position, or can beselectively biased towards both positions. In still otherimplementations, the projection portion 104 is not biased in eitherposition. The projection portion 104 can be biased using any suitablemechanism, such as a spring. When the projection portion 104 is biasedtowards only one of the stored and deployed positions, the obstruction100 generally include a retention feature that retains the projectionportion 104 in the non-biased position. The retention feature could be aclip, strap, or other similar feature. The retention feature could alsoinclude a structure on the projection portion 104 that snaps into acorresponding depression on the baseplate 102.

In some implementations, the retention feature is the depression 108,which may be sized so as to retain the projection portion 104 within thedepression 108 via a friction fit. For example, the portion of thebaseplate 102 that forms the outer periphery of the depression 108 mayinclude a small semi-resilient ridge. The semi-resilient ridge can forma circle with a diameter that is slightly less than the diameter of theprojection portion 104. When the projection portion 104 is moved to thestored position, the force imparted to the projection portion 104 canovercome the friction force between the projection portion 104 and thesemi-resilient ridge so that the projection portion 104 is seated in thedepression 108 and retained there.

When the projection portion 104 is selectively biased in both the storedposition and the deployed position, the projection portion 104 must bemoved a certain amount away from either position until the biasalternates, which causes the projection portion 104 to continue to movetowards the other position. For example, if the projection portion 104is selectively biased towards both positions and is currently in thestored position, the user (or a component of the system) must begin tomove the projection portion 104 away from the baseplate 102. Once theprojection portion 104 is moved a certain amount away from the baseplate102 and reaches an inflection point, the bias alternates towards thedeployed position. Moving the projection portion 104 from the deployedposition to the stored position also occurs in a similar fashion. Insome implementations, the inflection point may be about halfway betweenthe stored position and the deployed position. In these implementations,no retention feature is necessary, as the projection portion 104 isalways biased towards the position in which it is currently stored.

In the implementations where the projection portion 104 is not biasedtowards either position, the obstruction 100 still generally includes aretention feature to prevent gravity from causing the projection portion104 from moving between positions. For example, the projection portion104 may still snap into the depression 108 in the baseplate 102 so as toprevent the projection portion 104 from moving towards the deployedposition due to the influence of gravity. In these implementations,friction in the structure used to couple the projection portion 104 tothe baseplate 102 may retain the projection portion 104 in eitherposition. For example, friction in the hinge or other pivoting mechanismused to pivotally couple the projection portion 104 to the baseplate 102may impart a force on the projection 104 that is greater than the forceimparted on the projection portion 104 due to gravity. This causes theprojection portion 104 to remain in the stored position, even whengravity is imparting a force on the projection portion 104 towards thestored position.

The obstruction 100 can be formed from an opaque material that does notlet any light pass therethrough, or a partially transparent materialthat only lets a portion of light therethrough. For example, theobstruction 100 could be formed of one or more optical filters that areconfigured to block or lass different wavelengths of light.

As discussed herein, the system 10 is generally configured to recognizeobjects in the field of view of the camera and launch and application ortutorial based on the identified object. In some implementations, thistutorial can show the user how to apply a certain product, which couldbe makeup (e.g. lipstick, eyeliner, etc.), hair dye, toothpaste (e.g.the user brushing their teeth), or any other product that the user mayapply in front of the mirror.

FIGS. 17A and 17B illustrate an implementation of the mirror and thedisplay when the system identifies an object or product held by the userand launches a tutorial based on that object or product. As shown, thedisplay can show the time 36, and can also show information 37 relatingto the user's schedule. In the illustrated implementation, theinformation 37 includes an indication of when the user is supposed toleave for their destination. This information can be based on the user'scalendar, which can be stored in the memory of the system 10, or syncedfrom another device or location. The display also shows a variety oficons, that may or may not be interactive. As discussed herein, thedisplay 14 can display the lighting icon 38. The display can alsodisplay a weather icon 42 can show an image that is indicative of thecurrent weather conditions, such as clouds, a sun, snow, etc. An audioplayer icon 44 is interactive and can be operated by the user to playmusic, podcasts, radio stations, or other audio sources.

As shown in FIG. 17A, the system shows an image 45 that contains theuser 46 and the object 48 being held by the user 46. The image 45 can bea reflection in the mirror, or can be a still image or real-time videofeed shown on the display. When the image 45 appears as a reflection inthe mirror, the display is inactivated in the center where thereflection of the user 46 and the object 48 appears. When the object 48is in the field of view of the camera, the system can detect andidentify the object 48 and (if applicable) the product containedtherein.

FIG. 17B shows the state of the system upon detecting that object 48that the user 46 is holding the bottle of eyeliner. As shown, thedisplay can display an image 50 of the eyeliner (which can be a stockimage or an image captured by the camera) and a description 53 of theobject 48 or the product contained therein. The system can again show animage 45 of the user 46, either as a still image or real-time video feedon the display or as a reflection in the mirror. The display also showsan initiation icon 52 that can be activated by the user 46 to launch atutorial application, which can show the user 46 how to apply theeyeliner. The initiation icon 52 can include the words “START TUTORIAL,”or can show other text or images. Finally, the display shows acancellation icon 54 that the user 46 can interact with to exit thisstage if they do not wish to proceed with the tutorial. Activating thecancellation icon 54 causes the system to revert back to the previousstage. This can be useful when, for example, the system incorrectlyidentifies the object 48 that the user is holding, or if the user 46changes their mind and no longer wishes to use the object 48.

FIGS. 18A, 18B, and 18C illustrate the steps of the tutorial applicationthat is executed by the system. The tutorial can be launched responsiveto the user interacting with the initiation icon 52 that is shown inFIG. 17B. The tutorial can also be launched via another method, such asvoice activation. As illustrated in FIGS. 18A, 18B, and 18C, the image45 of the user 46 is shown as either a reflection in the mirror or as areal-time video feed shown on the display. The display also shows animage frame 56 from a live action video showing how to apply theeyeliner. An interactive icon 58 can be overlaid on the image frame 56.When the user 46 interacts with the icon 58, the display plays the videofor the user 46. The video may be stored in the memory of the system, orcan be downloaded from another location and played in response to theuser activating the icon. The video plays can play on a loop, or canplay a set number of times. While FIGS. 18A, 18B, and 18C show the icon58 overlaid on the image frame 56 during the tutorial, the live actionvideo can be played repeatedly during the tutorial. During the tutorialapplication, the display can also show a magnification icon 60 thatinitiates a magnification feature when activated by the user. Themagnification icon 60 can include text such as the word “MAGNIFIER,” orcould also be displayed as an image.

The tutorial application can also display an image or a series of imagesshowing the steps to apply the eyeliner. In one implementation, thedisplay displays an animated GIF (Graphics Interchange Format) thatshows the steps to the user. FIG. 18A illustrates the display showing afirst frame 62A of the GIF that demonstrates the first step of theapplication process. FIG. 18B illustrates the display showing a secondframe 62B of the GIF that demonstrates the second step of theapplication process. FIG. 18C illustrates the display 14 showing a thirdframe 62C of the GIF demonstrating the third step of the applicationprocess.

Each of the frames 62A-62C is indicated with a number and other markingsshowing the which action to take. For example, each step in FIGS. 18A,18B, and 18C includes an arrow 64A, 64B, or 64C that indicates to theuser which motion to take to apply the eyeliner and achieve the desiredresult. During the tutorial, the display can repeatedly show each frame62A-62C of the application process in sequential order until the user 46finishes applying the eyeliner. The image or series of images showingthe steps to apply the eyeliner can take the form of other file types aswell. For example, instead of showing a GIF, the display can insteadshow a series of individual still image files, such as JPEG files or PNGfiles. In some implementations, the display shows an animated videoinstead of an image or series of images. Generally, the GIF presents tothe user a looping video that illustrates an animation associated withthe tutorial, e.g., showing how to applying the product.

As shown in FIGS. 18A, 18B, and 18C, the display 14 during the tutorialapplication can still display the time 36, the information 37 related tothe user 46's schedule, the lighting icon 38, the weather icon 42related to the current weather conditions, and the audio player icon 44allowing the user to play music or other audio.

In some implementations, the system can assist the user 46 in conductingactivities (applying eyeliner) by highlighting portions of the user 46'sface where they need to apply the product. In one example, the lightsources of the system can emit light onto a portion of the user 46 (e.g.their face) to highlight where to apply the product. The light sourcescan include LEDs, lasers, or other suitable types of light-emittingdevices. The light emitted by the light sources can have any suitableshape or form, such as dots, circles, squares, triangles, curves, arcs,arches, lines, any combination thereof, or any other suitable shape. Thelight projected on to the user 46's face will be visible in the image 45of the user 46, either as a reflection in the mirror or as an image onthe display.

In another implementation, the display is used to guide the user 46 andto overlay template features onto the user 46's face to aid the user inconducting activities. For example, when the image 45 of the user 46 isa real-time image on the display, the display could highlight portionson the user 46's face where to apply the product. In anotherimplementation, the image 45 of the user 46 could be a reflection in themirror, but the display could still highlight any portions on the use46's face where to apply the product. The light in this location fromthe display will be brighter than the light reflecting off of the mirrorat this location, and thus the user 46 will be able to see the lightindicating where they are supposed to apply the product. The templatefeatures that can be shown by the display can take any suitable shape orform, such as dots, circles, squares, triangles, curves, arcs, arches,lines, any combination thereof, or any other suitable shape.

FIGS. 19A and 19B show the state of the system when the user initiatesthe magnification feature by selecting the magnification icon 60 asshown in FIGS. 18A-18C. The display can continue to show the image frame56 of the video and the icon 58 that can be activated to play the video,or can continue to show the video itself. The display also continues toshow the steps of the looping video illustrating the animationassociated with the steps for applying the eyeliner (e.g. the GIF). Inthe first stage of the magnification feature illustrated in FIG. 19A,the display displays a full-size image 66 of the user 46's face, alongwith a caption 68. The caption 68 can include the instructions “Tapanywhere to zoom in!” While during the tutorial the system can show theuser 46's face as just a reflection in the mirror, once themagnification feature is activated, the user 46's face is shown as animage on the display.

FIG. 19B shows a second stage of the magnification feature. Once theuser 46 taps or otherwise interacts with the image 66 of their face atan area of interest, the display shows a zoomed-in image 70 of theuser's face that includes that area of interest. For example, asillustrated in FIG. 19B, when the user is applying eyeliner to theuser's eyelashes, the user can zoom in on the portion of their face thatincludes their eyelashes. This allows the user to better view theireyelashes as they apply the eyeliner. The user can also manipulate thezoomed-in image 70 by interacting with the display. The user can swipeor drag the zoomed-in image so that different areas of the user's face.The user can also tap again to zoom back out. The display can showinstructions 72 that indicate to the user how to manipulate thezoomed-in image 70. In some implementations, the system is configured totrack the area of interest as the user moves. Thus, the display showsthe zoomed-in view of the area of interest, and continues to display thezoomed-in view of the area of interest as the user moves. The area ofinterest could be the user's eyes, noses, ears, mouth, teeth, etc., orany other feature on the user's face or body.

FIGS. 20A-20F illustrate a tutorial for applying hair dye that thesystem can execute for the user. During the tutorial, the display canshow the same information and icons discussed above, including the time36, information 37 relating to the user's schedule, the lighting icon38, the weather icon 40, the audio player icon 41, and the cancellationicon 54. At a first step in the tutorial as shown in FIG. 20A, thedisplay can show a list 73 of items the user will need to apply the hairdye. This list 73 is be displayed after the system identifies the objectthat the user is holding as hair dye. The display can also show theinitiation icon 52 that the user can interact with to begin thetutorial. The display may also show a warning 74 to the user related tothe time needed to complete the application of the hair dye. Forexample, if the user has to depart in a certain amount of time period(which is communicated to the user via the information 37 on thedisplay) but it normally takes longer than that time period to completethe application of the product, the system can issue a warning 74 to theuser indicating this fact.

Once the user initiates the tutorial by interacting with the initiationicon 52, the display can show a number of images to the user showingthem how to apply the hair dye. FIG. 20B illustrates the displaydisplaying an image 76A to the user showing how to mix and prepare thehair dye, along with instructions 78A for mixing and preparing the hairdye. FIG. 20C illustrates the display displaying an image 76B to theuser showing how to protect their skin and clothing from the hair dye,along with instructions 78B for protecting their skin and clothing fromthe hair dye. FIG. 20D illustrates the display displaying an image 76Cof a user preparing their hair for the dying process, along withinstructions 78C for preparing the user's hair for the dying process.FIG. 20E illustrates the display displaying an image 76D of a userapplying the hair dye to their hair, along with instructions 78D forapplying the hair dye. Finally, FIG. 20F illustrates the displaydisplaying an image 76E of a user rinsing the hair dye out of theirhair, along with instructions 78E for when and how to rinse the hair dyeout of their hair. At this last step shown in FIG. 20F, the display canalso show a timer 80 that indicates how much longer they need to keepthe hair dye in their hair before the rinse it out. The system may alsoinclude an alarm to indicate to the user when the timer 80 has reachedzero and they can begin to rinse the hair dye from their hair. The alarmcould be an audio alarm, a visual alarm, a combination thereof, or anyother suitable type of alarm.

As shown in FIG. 20E, the instructions 78D for applying the hair dye mayalso include a suggestion to use a 360° visualization feature. This isso that the user can ensure that they have applied the hair dye evenlyon their entire head, including the back and sides. At this step, thedisplay displays an icon 82 that the user can select to launch the 360°visualization feature, which is shown in FIGS. 21A and 21B. Once thevisualization feature is launched, the camera can begin recording theuser, e.g., the camera can begin generating image data that isreproducible as an image(s) or video of the user. At this point, thedisplay can show a live video feed 88 of the user, along with textinstructions 84 and pictorial instructions 86. The text instructions 84can, for example, instruct the use to being turning around so that thecamera can record their head. The pictorial instructions 86 can includea looping arrow showing the user which direction to rotate. Once therecording has been completed, the display can display a 3D model 90 ofthe user based on the recorded video, as shown in FIG. 21B. This 3Dmodel can be manipulated by the user to rotate and/or zoom in on variousportions of the user's head.

While FIGS. 18A-21B show tutorials for eyeliner and hair dye, the systemcan provide tutorials that are generally applicable to any type ofproduct or application thereof. For example, the system may providetutorials for the application of makeup, application of moisturizer,application of hair dye, application of hair gel, application of shavingcream, shaving, brushing teeth, eyebrow waxing, waxing, eyebrowthreading, threading, facials, ear cleaning, hair styling, applicationof contact lenses, application of facial masks, or any combinationthereof. Moreover, any of the features described with respect to thesefigures or other figures can be utilized on conjunction with any type oftutorial, or for other non-tutorial applications that the system mayexecute. For example, the 360° visualization feature can be used inconjunction with any taken by the user or application executed by thesystem, not just for a hair dying tutorial.

Referring now to FIGS. 22A-22H, the system can also execute applicationsthat allow the user to view modified images of themselves based on themodification of different characteristics of the user. For example, theuser can view images of themselves that show what they may look likeafter the application of different types of products or procedures, forexample applying different hair dye or getting different hair styles. Aspart of this process, the system can capture a “before” image, as shownin FIG. 22A. Here, the display can display a real-time video feed 200 onthe display that includes the user. The display can also include acentering indicia 202 that shows the user where to position themselvesto capture a high-quality before image. The purpose of the centeringindicia 202 is to ensure that any images that the system captures of theuser all show the user in the same location. The display also displaysinstructions 204 for capturing the before image. Once the user instructsthe system to capture the before image (for example via physicalinteraction with the display or via voice activation), the display canshow the before image 206 as shown in FIG. 22B. The display alsodisplays an initiation icon 52 that allows the user to begin selectingdifferent types of products or procedures to apply.

As shown in FIG. 22C, the display can show a plurality ofuser-selectable options 210A-210H. Each of the user-selectable options210A-210H are associated with a unique modification of a firstcharacteristic related to the user. In this example, that characteristicis hair color, and each individual user-selectable option 210A-21H isassociated with a unique proposed modification of that characteristic,e.g. different hair colors. Each of the user-selectable options210A-210H can also include an image showing the different proposedmodifications. In some implementations, the images may show an image ofa person with that proposed modification. In other implementations, theimages may show some sort of indicia representing the proposedmodification.

Along with the user-selectable options 210A-210H, the display can showthe before image 206. Once the system receives via an input device aselection from the user of one of the options 210A-210H, the display canshow a modified image 208 that shows the user with the proposedmodification of the characteristic corresponding to the selected option.In this example, the modified image 208 shows the user with the haircolor corresponding to the selection option. In some implementations,the display shows a real-time video feed of the user that is modified inreal-time as different modifications (e.g. hair colors) are selected bythe user. If the user likes any of the proposed modifications, they cantap or interact with the icon 212 to note that. Once the user hasidentified at least one proposed modification that they like, they cantap the confirmation icon 214 to proceed to the next stage. In otherimplementations, the system can display a prior image of the usercaptured the last time the user modified the first characteristic thesame as a selected option. This allows the user to check their ownhistory to determine which modification they like.

In some implementations, instead of displaying the options 210A-210H forthe user to select, the system can identify an object that the user isholding and show the modified image 208 based on that identification.For example, the system can determine that the user is holding a certaincolor hair dye, and can produce the modified image 208 that shows theuser with hair the color corresponding to the identified hair dye.

As shown in FIG. 22D, the display can then display a second set ofuser-selectable options 218A-218E that correspond to unique proposedmodifications of a second characteristic related to the user. In thisimplementation, the second characteristic is hair style. Each of thesecond set of options 218A-218E can include an image showing theproposed modification, or some other indicia. As the user selectsdifferent hair styles, the display can show an image 216 of a personwith that hair style. Generally, depending on what the secondcharacteristic of the user is, the system may not be able to show astill or real-time image/video of the user with the proposedmodification to that characteristic. For example, it may be difficultfor the system to show a modified still image or real-time video of theuser with a different hair color. However, the system can instead justshow stock images or videos of a person with that hair style.

After the user has selected at least one of options 218A-218E to thesecond characteristic using the icon 212, the user can interact with theicon 220 to move to the stage illustrated in FIG. 22E. Here, the displaycan show the before image 206 of the user, along with a plurality ofimages 222A, 222B, 222C that show the user in their before image 206 butwith the selected modifications to the first characteristic. The displaycan also show images 224A, 224B, 224C that correspond to the selectedmodifications to the second characteristic. The images 224A, 224B, 224Ccan be images of other people. After reviewing the options formodification of the first and second characteristic, the system candisplay an image 226 showing the desired modification to the firstcharacteristic and an image 228 showing the desired modification to thesecond characteristic, as shown in FIG. 22F.

As illustrated in FIG. 22G, once the user has actually undertaken theselected modifications to the characteristics (e.g. they have dyed andcut their hair), the system can obtain an “after” image 230. As shown,the display can show the real-time video feed 200 and the centeringindicia 202. The centering indicia 202 ensures that both the beforeimage 206 and the after image 230 will show the user from the sameangle. Once the system captures the after image 230, the system can showthe before image 206 and the after image 230 side-by-side to allow theuser to compare them. The system may also be able to use the beforeimage 206 and after image 230 to train itself to better show theproposed modifications to the user's characteristics. For example, thesystem can compare the image it generated to show a potentialmodification with the actual image of the user after they have undergonethat modification. The system can identify any differences and use thatto improve its generation of the modified images in the future.

The features discussed in connection with FIGS. 22A-22H can generally beused in connection with any type of activity and generally in anycombination. For example, these features can be used with activitiesother than cutting or dying the user's hair, such as applying makeup.Moreover, for any characteristic of the user, the display can showimages that illustrate a variety of different modifications to thatcharacteristic. The images can either be modified images of the user himor herself, or can be images of other people showing the modification.

The system can also maintain a photo history of the user's activities.In one implementation, the display can show the before and after imagesto the user after they complete the activity (e.g. applying the makeupor other substance) so they can examine how well they performed theactivity. In another implementation, the display can show to the userpast results from applying makeup or other substances. This can allowthe user to examine their past applications and determine whether theymade any errors that they need to try and avoid. This also allows theuser to check their history to determine which types of activities theymight want to repeat (e.g., a past haircut that the user would like tohave again).

Referring now to FIG. 23, the system is configured to allow the user toadjust the light emitted by the light sources via taps or swipes. In anexample, the display shows instructions 232 to the user for adjustingthe color. Horizontal icons 234A and 234B can be manipulated (by tappingon the icons or swiping across the icons) to adjust a property of thelight, such as brightness, warmth, color, temperature, etc. Verticalicons 236A and 236B can also be manipulated in the same fashion. In someimplementations, horizontal icons 234A and 234B can be used to adjust afirst property of the emitted light (e.g. brightness), while thevertical icons 236A and 236B are used to adjust a second property of theemitted light (e.g. color).

In some implementations, the display displays a virtual power button tothe user when in a rest mode or an off mode. When the user interactswith the virtual power button, the system wakes up or turns on. The usercan interact with this virtual power button by touching the surface ofthe mirror where the virtual power button is displayed. In otherimplementations, the system includes a physical power button that theuser may interact with. In still other implementations, the system 10includes a proximity sensor that is configured to detect when the userhas placed his or her finger near within a threshold distance of theuser-side surface of the mirror for at least a specified time period.Detection of this causes the system to wake up or turn on.

In some implementations, the system can execute an application to testthe user's eyesight or other properties related to the user's eyes. Thisapplication can be launched manually by the user. However, the systemmay also launch the application automatically upon detecting that theuser is experiencing difficulties with their eyesight. People whoseeyesight is deteriorating will often begin to squint more than theynormally do. The system can be configured to detect the user squinting,for example, by detecting wrinkles that appear on the user's face neartheir eyes when they squint. The system may also detect that the user issquinting in other ways. Once the application is launched, the systemcan perform a variety of eyesight tests for the user, for example bydisplaying a series of numbers and/or letters that get increasinglysmall, and having the user identify which series they can still seeproperly.

In some implementations, the system can execute a stretchingapplication. As a part of this application, the system can detect theuser's posture (whether sitting, standing, walking, running, jumping,etc.) and recommend exercises to improve the user's posture.

Alternative Implementations:

Alternative Implementation 1. A system comprising: a mirror having afirst side and an opposing second side, the mirror being configured topermit a first portion of light incident on the first side to transmittherethrough and to permit a second portion of the light incident on thefirst side to reflect therefrom; an electronic display positionedadjacent to the second side of the mirror such that the electronicdisplay is at least partially visible through the first side of themirror responsive to the electronic display being at least partiallyactivated; one or more sensors positioned generally about a periphery ofthe mirror and being configured to detect a presence of and a relativelocation of an object positioned adjacent to the first side of themirror; a light source configured to produce light and at leastpartially aid in illuminating the object responsive to the object beingadjacent to the first side of the mirror; and a camera positionedadjacent the second side of the mirror, the camera being configured todetect the object.

Alternative Implementation 2. The system of Alternative Implementation1, further comprising one or more processors configured to adjust acolor or an intensity of the light source.

Alternative Implementation 3. The system of Alternative Implementation1, wherein the light source includes one more light-emitting diodes.

Alternative Implementation 4. The system of Alternative Implementation1, wherein the mirror has a first axis and a second axis perpendicularto the first axis, and wherein the one or more sensors are configured todetect a first axial position of the object relative to the first axisof the mirror and a second axial position of the object relative to thesecond axis of the mirror.

Alternative Implementation 5. The system of Alternative Implementation4, wherein the one or more sensors includes a first set of one or moretransmitters disposed along a first portion of the mirror parallel tothe first axis and a first set of one or more receivers disposed along asecond opposing portion of the mirror parallel to the first axis, thefirst set of one or more transmitters and the first set of one or morereceivers configured to detect the first axial position of the object.

Alternative Implementation 6. The system of Alternative Implementation5, wherein the one or more sensors includes a second set of one or moretransmitters disposed along a third portion of the mirror parallel tothe second axis and a second set of one or more receivers disposed alonga fourth opposing portion of the mirror parallel to the second axis, thesecond set of one or more transmitters and the second set of one or morereceivers configured to detect the second axial position of the object.

Alternative Implementation 7. The system of Alternative Implementation6, wherein the first axis is a vertical axis and the second axis is ahorizontal axis.

Alternative Implementation 8. The system of Alternative Implementation6, wherein at least a portion of the one or more sensors is disposedwithin a sensor frame that is coupled to the periphery of the mirror.

Alternative Implementation 9. The system of Alternative Implementation1, further comprising one or more processors configured to cause thedisplay to aid in illuminating the object by activating at least aportion of the display.

Alternative Implementation 10. The system of Alternative Implementation9, wherein the one or more processors are configured to activate theportion of the display responsive to at least one of the one or moresensors detecting the presence and relative location of the objectpositioned adjacent to the first side of the mirror.

Alternative Implementation 11. The system of Alternative Implementation9, wherein the activated portion of the display includes a ring-shapedconfiguration such that the activated portion of the display isgenerally aligned with an outer periphery of the object.

Alternative Implementation 12. The system of Alternative Implementation11, wherein the activated portion of the display substantially enclosesa non-activated portion of the display, the non-activated portion of thedisplay being generally aligned with an interior of the outer peripheryof the object.

Alternative Implementation 13. The system of Alternative Implementation9, wherein the activated portion of the display has a shape thatcorresponds to a shape of the object.

Alternative Implementation 14. The system of Alternative Implementation9, wherein the object is a face, and wherein the display is caused to beactivated responsive to the face being located within a thresholddistance from the mirror.

Alternative Implementation 15. The system of Alternative Implementation14, wherein the threshold distance is less than about five inches.

Alternative Implementation 16 The system of Alternative Implementation1, further comprising an ambient light sensor configured to detect anambient light condition.

Alternative Implementation 17. The system of Alternative Implementation16, further comprising one or more processors configured to determine adifference between the detected ambient light condition and a desiredlight condition.

Alternative Implementation 18. The system of Alternative Implementation17, wherein at least one of the one or more processors is configured toadjust the light produced by the light source based on the determineddifference between the detected ambient light condition and the desiredlight condition, such that the ambient light condition and the lightproduced by the light source combine to cause the object to beilluminated according to the desired light condition.

Alternative Implementation 19. The system of Alternative Implementation16, wherein the ambient light sensor is included in the camera.

Alternative Implementation 20. The system of Alternative Implementation1, wherein the display is configured to display one or moreuser-selectable icons visible to a user through the mirror, and whereinone or more processors are configured to adjust the light produced bythe light source responsive to a selection of one of the one or moreuser-selectable icons.

Alternative Implementation 21. The system of Alternative Implementation1, wherein the display is configured to display real-time video imagescaptured by the camera.

Alternative Implementation 22. The system of Alternative Implementation1, further comprising one or more processors configured to execute afirst application, the display being configured to display a first typeof information related the first application.

Alternative Implementation 23. The system of Alternative Implementation22, wherein the camera is configured to monitor an area adjacent to thefirst side of the mirror, and wherein at least one of the one or moreprocessors is configured to identify the object.

Alternative Implementation 24. The system of Alternative Implementation23, wherein responsive to the identification of the object, at least oneof the one or more processors is configured to cause the display todisplay a second type of information related to the first application,the second type of information being (i) different from the first typeof information and (ii) based on the identified object.

Alternative Implementation 25. The system of Alternative Implementation23, wherein responsive to the identification of the object, at least oneof the one or more processors is configured to execute a secondapplication different from the first application, the second applicationbeing based on the identified object.

Alternative Implementation 26. The system of Alternative Implementation1, wherein the object is a toothbrush, a razor, a comb, a makeupimplement, a face of a user, or any combination thereof.

Alternative Implementation 27. A method of modifying execution anapplication, comprising: providing an electronic display device and amirror, the mirror having a first side and an opposing second side, theelectronic display device being positioned adjacent to the second sideof the mirror such the electronic display device is at least partiallyvisible through the first side of the mirror responsive to theelectronic display device being activated; executing, on one or moreprocessing devices communicatively coupled to the electronic displaydevice, a first application; displaying, on the electronic displaydevice, a first type of information related to the first application;monitoring an area adjacent to the first side of the mirror with acamera communicatively coupled to the one or more processing devices;detecting, with the one or more processing devices, an object disposedin the area adjacent to the first side of the mirror; identifying, withthe one or more processing devices, the detected object from a pluralityof pre-determined potential objects; and responsive to identifying thedetected object, modifying the execution of the first application basedon the identified detected object.

Alternative Implementation 28. The method of Alternative Implementation27, wherein the modifying the execution of the first applicationincludes displaying a second type of information related to the firstapplication, the second type of information being different from thefirst type of information.

Alternative Implementation 29. The method of Alternative Implementation27, wherein the modifying the execution of the first applicationincludes executing a second application on the processing devicedifferent from the first application.

Alternative Implementation 30. The method of Alternative Implementation27, wherein the object is a toothbrush, a razor, a makeup implement, orany combination thereof.

Alternative Implementation 31. A method of illuminating a face,comprising: providing an electronic display device and a mirror, themirror having a first side and an opposing second side, the electronicdisplay device being positioned adjacent to the second side of themirror such the electronic display device is at least partially visiblethrough the first side of the mirror responsive to the electronicdisplay device being activated; monitoring an area adjacent to the firstside of the mirror with one or more sensors; detecting, with the one ormore sensors, the face responsive to the face being positioned within athreshold distance from a surface of the mirror on the second side ofthe mirror; determining, using one or more processors communicativelycoupled to the one or more sensors, an outer periphery of the face; andactivating a portion of the electronic display device to illuminate theface.

Alternative Implementation 32. The method of Alternative Implementation31, wherein the activated portion of the electronic display deviceincludes a ring-shaped configuration such that the activated portion ofthe electronic display device is generally aligned with the outerperiphery of the face.

Alternative Implementation 33. The method of Alternative Implementation32, wherein the activated portion of the electronic display devicesubstantially encloses a non-activated portion of the display, thenon-activated portion of the electronic display device being generallyaligned with an interior of the outer periphery of the face.

Alternative Implementation 34. The method of Alternative Implementation31, wherein the activated portion of the electronic display device has ashape that generally corresponds to a shape of the face.

Alternative Implementation 35. The method of Alternative Implementation31, wherein the threshold distance is less than about five inches.

Alternative Implementation 36. A system for illuminating a face of auser, the system comprising: a smart mirror device including: a frame; amirror coupled to the frame; one or more sensors coupled to the frameand positioned generally adjacent to at least a portion of a peripheryof the mirror; an electronic display device coupled to the frame suchthat the electronic display device is positioned adjacent to a portionof the mirror; and one or more processors configured to executeinstructions stored in one or more memory devices such that the smartmirror device is caused to: responsive to the face of the user beingpositioned within a threshold distance from a surface of the mirror,detect, via at least one of the one or more sensors, the face of theuser; determine an outer periphery of the face; and activate a portionof the electronic display device to aid in illuminating the face.

Alternative Implementation 37. The system of Alternative Implementation36, wherein the activated portion of the electronic display has agenerally oval shape, a generally circular shape, a generally curvedshape, or any combination thereof.

Alternative Implementation 38. The system of Alternative Implementation36, wherein the activated portion of the electronic display also aids inilluminating a reflection of the face in the mirror.

Alternative Implementation 39. The system of Alternative Implementation36, wherein the mirror is coupled to the frame such that the mirror isless than one inch from a screen of the electronic display.

Alternative Implementation 40. A method of compensating for an ambientlight condition, comprising: providing an electronic display device anda mirror, the mirror having a first side and an opposing second side,the electronic display device being positioned adjacent to the secondside of the mirror such the electronic display device is at leastpartially visible through the first side of the mirror responsive to theelectronic display device being activated; detecting, using an ambientlight sensor, the ambient light condition illuminating an object;determining, using one or more processors communicatively coupled to theambient light sensor, a difference between the detected ambient lightcondition and a desired light condition; producing light using one ormore lighting sources based on the determined difference between theambient light condition and the desired light condition; andilluminating the object with the produced light such that the ambientlight condition and the produced light combine to cause the object to beilluminated according to the desired lighting condition.

Alternative Implementation 41. The method of Alternative Implementation40, wherein the ambient light sensor is a camera.

Alternative Implementation 42. The method of Alternative Implementation41, wherein the ambient light condition is detected by capturing animage of an object and analyzing the captured image.

Alternative Implementation 43. A system for compensating for an ambientlighting condition, the system comprising: a smart mirror deviceincluding: a frame; a mirror coupled to the frame; an ambient lightingsensor coupled to the frame; one or more lighting sources; an electronicdisplay device coupled to the frame such that the electronic displaydevice is positioned adjacent to a portion of the mirror; and one ormore processors configured to execute instructions stored in one or morememory devices such that the smart mirror device is caused to: detect,using the ambient lighting sensor, the ambient lighting conditionadjacent to the system; determine a difference between the detectedambient lighting condition and a desired lighting condition; and emitlight, via one or more lighting sources, based on the determineddifference between the ambient lighting condition and the desiredlighting condition.

Alternative Implementation 44. A method of capturing an image of a user,comprising: providing an electronic display device and a mirror, themirror having a first side and an opposing second side, the electronicdisplay device being positioned adjacent to the second side of themirror such the electronic display device is at least partially visiblethrough the first side of the mirror responsive to the electronicdisplay device being activated; illuminating, using light produced byone or more light sources, a user located adjacent to the first side ofthe mirror; capturing, using a camera, a first image of the user locatedadjacent to the first side of the mirror; displaying on the electronicdisplay device the captured first image of the user; displaying, on theelectronic display device, one or more user-selectable icons, each iconcorresponding to a different lighting condition; detecting a userselection of at least one of the one or more user-selectable icons;adjusting the light produced by the one or more light sources based onthe user selection of the at least one of the one or moreuser-selectable icons such that the user is illuminated by a selectedlighting condition; and capturing, using the camera, a second image ofthe user illuminated by the selected lighting condition.

Alternative Implementation 45. The system of Alternative Implementation6, wherein the mirror and the sensor frame have an identical shape.

Alternative Implementation 46. The system of Alternative Implementation6, wherein the mirror and the sensor frame have a different shape.

Alternative Implementation 47. The system of Alternative Implementation6, wherein the sensor frame has a rectangular shape, a square shape, atriangle shape, a circle shape, or an oval shape.

Alternative Implementation 48. The system of Alternative Implementation6, wherein the sensor frame has a rectangular shape, a square shape, atriangle shape, a circle shape, or an oval shape.

Alternative Implementation 49. A system comprising: a mirror having afirst side and an opposing second side, the mirror being configured topermit a first portion of light incident on the first side to transmittherethrough and to permit a second portion of the light incident on thefirst side to reflect therefrom; a first electronic display positionedadjacent to the second side of the mirror such that the first electronicdisplay is at least partially visible through the first side of themirror responsive to the first electronic display being at leastpartially activated; a second electronic display positioned adjacent tothe second side of the mirror such that the second electronic display isat least partially visible through the first side of the mirrorresponsive to the second electronic display being at least partiallyactivated, the second electronic display being spaced apart from thefirst electronic display such that a gap is defined between the firstelectronic display and the second electronic display; one or moresensors positioned generally about a periphery of the mirror and beingconfigured to detect a presence of and a relative location of an objectpositioned adjacent to the first side of the mirror; a light sourceconfigured to produce light and at least partially aid in illuminatingthe object responsive to the object being adjacent to the first side ofthe mirror; and a camera configured to detect the object, the camerabeing positioned adjacent the second side of the mirror and positionedwithin the gap between the first electronic display and the secondelectronic display.

Alternative Implementation 50. A system comprising: a frame; a mirrorcoupled to the frame, the mirror having a first side and an opposingsecond side, the mirror being configured to permit a first portion oflight incident on the first side to transmit therethrough and to permita second portion of the light incident on the first side to reflecttherefrom; an electronic display couple to the frame such that theelectronic display is positioned adjacent to the second side of themirror; a plurality of sensors positioned generally about at least aportion of a periphery of the mirror and being configured to detect apresence of and a relative location of an object positioned adjacent tothe first side of the mirror; a camera positioned adjacent the secondside of the mirror and positioned such that the object is within a fieldof view of the camera responsive to the object being positioned adjacentto the first side of the mirror; and an obstruction coupled the frameand being configured move between a first position where the obstructionobscures the field of view of the camera and a second position where theobstruction does not obscure the field of view of the camera.

Alternative Implementation 51. The system of Alternative Implementation50, wherein the obstruction is pivotally coupled to the frame.

Alternative Implementation 52. The system of Alternative Implementation50, wherein the obstruction is slidably coupled to the frame.

Alternative Implementation 53. The system of Alternative Implementation50, wherein the obstruction includes an opaque material.

Alternative Implementation 54. The system of Alternative Implementation50, wherein the obstruction includes a partially transparent materialsuch that only a portion of light is able to pass therethrough.

Alternative Implementation 55. The system of Alternative Implementation50, wherein the obstruction includes one or more optical filters.

Alternative Implementation 56. The system of Alternative Implementation50, wherein the obstruction is biased towards the first position.

Alternative Implementation 57. The system of Alternative Implementation50, wherein the obstruction is biased towards the second position.

Alternative Implementation 58. The system of Alternative Implementation50, wherein the obstruction is configured to be biased towards the firstposition or towards the second position.

Alternative Implementation 59. The system of Alternative Implementation50, wherein the obstruction is configured to be manually moved betweenthe first position and the second position.

Alternative Implementation 60. The system of Alternative Implementation50, wherein the obstruction is configured to be automatically movedbetween the first position and the second position using one or moreelectronic actuation devices.

Alternative Implementation 61. The system of Alternative Implementation60, wherein the one or more activation devices include a solenoid, aspring, a lever, a magnet, or any combination thereof.

Alternative Implementation 62. The system of Alternative Implementation50, wherein the electronic display is at least partially visible throughthe first side of the mirror only when to the electronic display isactivated.

Alternative Implementation 63. The system of Alternative Implementation50, further comprising a light source configured to produce light and atleast partially aid in illuminating the object.

Alternative Implementation 64. A system comprising: a frame; a mirrorcoupled to the frame; an electronic display couple to the frame suchthat the electronic display is positioned adjacent to a rear side of themirror; a camera coupled to the frame such that a field of view of thecamera includes an area adjacent to a front side of the mirror; and anobstruction coupled the frame and being configured move between a firstposition and a second position, responsive to the obstruction being inthe first position, the obstruction is configured to obscure at least aportion of the field of view of the camera, responsive to theobstruction being in the second position, the obstruction is configuredto not obscure the field of view of the camera.

Alternative Implementation 65. The system of Alternative Implementation64, wherein the mirror is a two-way mirror such that the field of viewof the camera is able to extend into the area adjacent to the front sideof the mirror.

Alternative Implementation 66. The system of Alternative Implementation64, wherein the electronic display device includes an aperturetherethrough such that the field of view of the camera is able to extendthrough the aperture and into the area adjacent to the front side of themirror.

Alternative Implementation 67. The system of Alternative Implementation66, wherein the aperture is located in a generally central portion ofthe electronic display device.

Alternative Implementation 68. A system for providing a tutorial, thesystem comprising: a smart mirror device including: a frame; a mirrorcoupled to the frame; an electronic display device coupled to the framesuch that the electronic display device is positioned adjacent to aportion of the mirror; and one or more processors configured to executeinstructions stored in one or more memory devices such that the smartmirror device is caused to: responsive to receiving an input to begin afirst tutorial, display, on the electronic display device, (i) a firstlooping video illustrating a human performing a how-to tutorial for afirst type of activity, (ii) a second looping video illustrating ananimation associated with the how-to tutorial shown in the first loopingvideo, and (iii) a real-time video feed of a user; and responsive toreceiving a magnifier input associated with a portion of the user in thedisplayed real-time video feed, display, on the electronic displaydevice, a zoomed in view of the user including the portion of the user.

Alternative Implementation 69. The system of Alternative Implementation68, wherein the smart mirror further includes a light source that isconfigured to emit light onto a portion of the user.

Alternative Implementation 70. The system of Alternative Implementation69, wherein the light source includes one or more lasers that areconfigured to project one or more shapes on the user.

Alternative Implementation 71. The system of Alternative Implementation70, wherein the one or more shapes include dots, circles, squares,triangles, curves, arcs, arches, lines, or any combination thereof.

Alternative Implementation 72. The system of Alternative Implementation70, wherein the one or more shapes projected onto the user indicate oneor more locations for the user to apply one or more products associatedwith the first type of activity.

Alternative Implementation 73. The system of Alternative Implementation68, wherein the first type of activity is application of makeup,application of moisturizer, application of hair dye, application of hairgel, application of shaving cream, shaving, brushing teeth, eyebrowwaxing, waxing, eyebrow threading, threading, facials, ear cleaning,hair styling, application of contact lenses, application of facialmasks, or any combination thereof.

Alternative Implementation 74. The system of Alternative Implementation68, wherein the one or more processors are further configured to executeinstructions stored in the one or more memory devices such that thesmart mirror device is caused to: display, adjacent to the real-timevideo feed of the user, a selectable magnifier element.

Alternative Implementation 75. A system for providing a tutorial, thesystem comprising: a frame; a mirror coupled to the frame; an electronicdisplay device coupled to the frame such that the electronic displaydevice is positioned adjacent to a portion of the mirror; and one ormore processors configured to execute instructions stored in one or morememory devices such that the system is caused to: responsive toreceiving an input to begin a first tutorial, display, on the electronicdisplay device, a first looping video illustrating a human performing ahow-to tutorial for a first type of activity.

Alternative Implementation 76. The system of Alternative Implementation75, wherein the system is further caused to display a second loopingvideo illustrating an animation associated with the how-to tutorialshown in the first looping video.

Alternative Implementation 77. The system of Alternative Implementation76, wherein the second looping video is displayed below the firstlooping video and aligned therewith such that a centerline of the firstlooping video and a centerline of the second looping video arecoincident.

Alternative Implementation 78. The system of Alternative Implementation75, wherein the system is further caused to display a real-time videofeed of a user.

Alternative Implementation 79. The system of Alternative Implementation78, wherein the system is further caused to, responsive to receiving amagnifier input associated with a portion of the user in the displayedreal-time video feed, display, on the electronic display device, azoomed in view of the user including the portion of the user.

Alternative Implementation 80. The system of Alternative Implementation75, wherein the system is further caused to display a still image of auser.

Alternative Implementation 81. The system of Alternative Implementation80, wherein the system is further caused to, responsive to receiving amagnifier input associated with a portion of the user in the displayedstill image, display, on the electronic display device, a zoomed instill image of the user including the portion of the user.

Alternative Implementation 82. A system for providing a tutorial, thesystem comprising: a frame; a mirror coupled to the frame; an electronicdisplay device coupled to the frame such that the electronic displaydevice is positioned adjacent to a portion of the mirror; and one ormore processors configured to execute instructions stored in one or morememory devices such that the system is caused to: responsive toreceiving an input to begin a first tutorial, display, on the electronicdisplay device, (i) a first looping video illustrating a humanperforming a how-to tutorial for a first type of activity and (ii) areal-time video feed of a user; and modify the real-time video feed ofthe user to overlay on a portion of the user one or more templatefeatures associated with the first type of activity.

Alternative Implementation 83. The system of Alternative Implementation82, wherein the first type of activity is application of makeup,application of moisturizer, application of hair dye, application of hairgel, application of shaving cream, shaving, brushing teeth, eyebrowwaxing, waxing, eyebrow threading, threading, facials, ear cleaning,hair styling, application of contact lenses, application of facialmasks, or any combination thereof.

Alternative Implementation 84. The system of Alternative Implementation82, wherein the one or more template features include one or more dots,one or more circles, one or more squares, one or more triangles, one ormore curves, one or more arcs, one or more arches, one or more lines, orany combination thereof.

Alternative Implementation 85. The system of Alternative Implementation82, wherein the one or more template features aid the user in conductingthe first type of activity.

Alternative Implementation 86. A system for capturing and displayingimages of a user, the system comprising: a frame; a mirror coupled tothe frame; an electronic display device coupled to the frame such thatthe electronic display device is positioned adjacent to a portion of themirror; a camera coupled to the frame; and one or more processorsconfigured to execute instructions stored in one or more memory devicessuch that the system is caused to: generate, using the camera, videodata associated with at least a portion of the user; display, on theelectronic display device, the generated video data as a real-time videofeed of at least a portion of the user; capture, from the video data,first image data reproducible as a first image of the at least a portionof the user; display the first image and a first set of selectableoptions, the first set of selectable options being associated with afirst characteristic of the user; receive, via an input device, aselection of one of the first set of selectable options; and responsiveto receiving the selection of the one or the first set of selectableoptions, display a second image of the user, the second image of theuser being a modified version of the first image of the user andillustrating a proposed modification to the first characteristic of theuser, the modification being based on the selection of the one of thefirst set of selectable options.

Alternative Implementation 87. The system of Alternative Implementation86, wherein the system is further caused to: display a second set ofselectable options, the second set of selectable options beingassociated with a second characteristic of the user; and receive, viathe input device, a selection of one of the second set of selectableoptions.

Alternative Implementation 88. The system of Alternative Implementation87, wherein the system is further caused to, responsive to receiving theselection of one of the second set of selectable options second, displaya third image of the user, the third image of the user being a secondmodified version of the first image of the user, the second modificationbeing based on the selection of the one of the second set of selectableoptions.

Alternative Implementation 89. The system of Alternative Implementation88, wherein the system is further configured to simultaneously displaythe first image of the user, the second image of the user, and the thirdimage of the user.

Alternative Implementation 90. The system of Alternative Implementation87, wherein the system is further configured to, responsive to receivingthe selection of the one of the second set of selectable options,display (i) the first image of the user, (ii) the second image of theuser; and (iii) a third image associated with the selection of the oneof the second set of selectable options, the third image illustrating aproposed modification to the second characteristic of the user.

Alternative Implementation 91. The system of Alternative Implementation87, wherein the first characteristic of the user is a hair color of theuser.

Alternative Implementation 92. The system of Alternative Implementation91, wherein the first image of the user shows the user with an existinghair color and wherein the second image of the user shows the user witha modified hair color, the modified hair color corresponding to theselection of the one of the first set of selectable options.

Alternative Implementation 93. The system of Alternative Implementation91, wherein each of the first set of selectable options is associatedwith a distinct hair color.

Alternative Implementation 94. The system of Alternative Implementation91, wherein the second characteristic of the user is a hair style of theuser.

Alternative Implementation 95. The system of Alternative Implementation94, wherein each selectable option of the second set of selectableoptions is associated with a distinct hair style.

Alternative Implementation 96. The system of Alternative Implementation86, wherein each of the first set of selectable options is a uniqueproposed modification of the first characteristic of the user.

Alternative Implementation 97. The system of Alternative Implementation86, wherein each of the first set of user selectable options includes animage associated with a unique proposed modification of the firstcharacteristic of the user.

Alternative Implementation 98. A system for displaying images, thesystem comprising: a frame; a mirror coupled to the frame; an electronicdisplay device coupled to the frame such that the electronic displaydevice is positioned adjacent to a portion of the mirror; a cameracoupled to the frame; and one or more processors configured to executeinstructions stored in one or more memory devices such that the systemis caused to: display, on the electronic display device, a real-timevideo feed of a user; capture first image data reproducible as a firstimage of the user; identify an object being held by the user in thefirst image; and responsive to identifying the object being held by theuser in the first image, display a second image of the user, the secondimage of the user being a modified version of the first image of theuser, the modification being based on the identified object being heldby the user.

Alternative Implementation 99. The method of Alternative Implementation98, wherein the object includes hair dye and wherein the second image ofthe user illustrates the user having a hair color associated with thehair dye.

Alternative Implementation 100. The method of Alternative Implementation98, wherein the object includes lipstick and wherein the second image ofthe user illustrates the user having a lip color associated with thelipstick.

Alternative Implementation 101. The method of Alternative Implementation98, wherein the object includes makeup and wherein the second image ofthe user is a modified version of the first image that is modified basedon the identified makeup.

Alternative Implementation 102. A system for displaying images, thesystem comprising: a frame; a mirror coupled to the frame; an electronicdisplay device coupled to the frame such that the electronic displaydevice is positioned adjacent to a portion of the mirror; a cameracoupled to the frame; and one or more processors configured to executeinstructions stored in one or more memory devices such that the systemis caused to: display, on the electronic display device, a real-timevideo feed of a user; receive, via an input device, a selection of anarea of interest of the user shown in the real-time video feed of theuser; display, on the electronic display device, a zoomed-in real-timevideo feed of the area of interest of the user; and continue to display,on the electronic display device, the zoomed-in real time video feed ofthe area of interest of the user responsive to movement of the user.

It is contemplated that any elements of any one of the above alternativeimplementations can be combined with any elements of one or more of anyof the other alternative implementations and such combinations areintended as being included in the scope of the present disclosure.

While the present disclosure has been described with reference to one ormore particular implementations, those skilled in the art will recognizethat many changes may be made thereto without departing from the spiritand scope of the present disclosure. Each of these implementations andobvious variations thereof is contemplated as falling within the spiritand scope of the present disclosure. It is also contemplated thatadditional implementations according to aspects of the presentdisclosure may combine any number of features from any of theimplementations described herein.

1. A system comprising: a mirror having a first side and an opposingsecond side, the mirror being configured to permit a first portion oflight incident on the first side to transmit therethrough and to permita second portion of the light incident on the first side to reflecttherefrom; an electronic display positioned adjacent to the second sideof the mirror such that the electronic display is at least partiallyvisible through the first side of the mirror responsive to theelectronic display being at least partially activated; one or moresensors positioned generally about a periphery of the mirror and beingconfigured to detect a presence of and a relative location of an objectpositioned adjacent to the first side of the mirror; a light sourceconfigured to produce light and at least partially aid in illuminatingthe object responsive to the object being adjacent to the first side ofthe mirror; and a camera positioned adjacent the second side of themirror, the camera being configured to detect the object.
 2. The systemof claim 1, further comprising one or more processors configured toadjust a color or an intensity of the light source, the light sourceincluding one or more light-emitting diodes.
 3. (canceled)
 4. The systemof claim 1, wherein the mirror has a first axis and a second axisperpendicular to the first axis, and wherein the one or more sensors areconfigured to detect a first axial position of the object relative tothe first axis of the mirror and a second axial position of the objectrelative to the second axis of the mirror, the one or more sensor beingdisposed within a sensor frame that is coupled to the periphery of themirror.
 5. The system of claim 4, wherein the one or more sensorsincludes a first set of one or more transmitters disposed along a firstportion of the mirror parallel to the first axis and a first set of oneor more receivers disposed along a second opposing portion of the mirrorparallel to the first axis, the first set of one or more transmittersand the first set of one or more receivers configured to detect thefirst axial position of the object, and wherein the one or more sensorsincludes a second set of one or more transmitters disposed along a thirdportion of the mirror parallel to the second axis and a second set ofone or more receivers disposed along a fourth opposing portion of themirror parallel to the second axis, the second set of one or moretransmitters and the second set of one or more receivers configured todetect the second axial position of the object, the first axis being avertical axis and the second axis being a horizontal axis. 6-8.(canceled)
 9. The system of claim 1, further comprising one or moreprocessors configured to cause the display to aid in illuminating theobject by activating at least a portion of the display.
 10. The systemof claim 9, wherein the one or more processors are configured toactivate the portion of the display responsive to at least one of theone or more sensors detecting the presence and relative location of theobject positioned adjacent to the first side of the mirror.
 11. Thesystem of claim 9, wherein the activated portion of the display includesa ring-shaped configuration such that the activated portion of thedisplay is generally aligned with an outer periphery of the object. 12.The system of claim 11, wherein the activated portion of the displaysubstantially encloses a non-activated portion of the display, thenon-activated portion of the display being generally aligned with aninterior of the outer periphery of the object.
 13. The system of claim9, wherein the activated portion of the display has a shape thatcorresponds to a shape of the object.
 14. The system of claim 9, whereinthe object is a face, and wherein the display is caused to be activatedresponsive to the face being located within a threshold distance fromthe mirror.
 15. The system of claim 14, wherein the threshold distanceis less than about five inches.
 16. The system of claim 1, furthercomprising: an ambient light sensor included in the camera, the ambientlight sensor being configured to detect an ambient light condition; andone or more processors configured to determine a difference between thedetected ambient light condition and a desired ambient light condition,wherein at least one of the one or more processors is configured toadjust the light produced by the light source based on the determineddifference between the detected ambient light condition and the desiredlight condition, such that the ambient light condition and the lightproduced by the light source combine to cause the object to beilluminated according to the desired light condition. 17-19. (canceled)20. The system of claim 1, wherein the display is configured to displayone or more user-selectable icons visible to a user through the mirror,and wherein one or more processors are configured to adjust the lightproduced by the light source responsive to a selection of one of the oneor more user-selectable icons.
 21. The system of claim 1, wherein thedisplay is configured to display real-time video images captured by thecamera, and wherein the object is a toothbrush, a razor, a comb, amakeup implement, a face of a user, or any combination thereof.
 22. Thesystem of claim 1, further comprising one or more processors configuredto execute a first application, the display being configured to displaya first type of information related the first application, and whereinthe camera is configured to monitor an area adjacent to the first sideof the mirror, and wherein at least one of the one or more processors isconfigured to identify the object.
 23. (canceled)
 24. The system ofclaim 22, wherein responsive to the identification of the object, atleast one of the one or more processors is configured to cause thedisplay to display a second type of information related to the firstapplication, the second type of information being (i) different from thefirst type of information and (ii) based on the identified object. 25.The system of claim 22, wherein responsive to the identification of theobject, at least one of the one or more processors is configured toexecute a second application different from the first application, thesecond application being based on the identified object. 26-102.(canceled)
 103. The system of claim 1, further comprising an obstructioncoupled to the frame and configured to move between a first positionwhere the obstruction obscures the field of view of the camera and asecond position where the obstruction does not obscure the field of viewof the camera.
 104. The system of claim 1, wherein the electronicdisplay is a first electronic display, and wherein the system furthercomprises a second electronic display positioned adjacent to the secondside of the mirror such that the second electronic display is at leastpartially visible through the first side of the mirror responsive to theadditional electronic display being at least partially activated, thesecond electronic display being spaced apart from the first electronicdisplay such that a gap is defined between the first electronic displayand the second electronic display.
 105. A system comprising: a mirrorhaving a first side and an opposing second side, the mirror beingconfigured to permit a first portion of light incident on the first sideto transmit therethrough and to permit a second portion of the lightincident on the first side to reflect therefrom; an electronic displaypositioned adjacent to the second side of the mirror such that theelectronic display is at least partially visible through the first sideof the mirror responsive to the electronic display being at leastpartially activated; one or more sensors positioned generally about aperiphery of the mirror and being configured to detect a presence of anda relative location of an object positioned adjacent to the first sideof the mirror; a light source configured to produce light and at leastpartially aid in illuminating the object responsive to the object beingadjacent to the first side of the mirror; a camera positioned adjacentthe second side of the mirror, the camera being configured to detect theobject; an obstruction coupled to the frame and configured to movebetween a first position where the obstruction obscures the field ofview of the camera and a second position where the obstruction does notobscure the field of view of the camera; and one or more processorsconfigured to cause the display to aid in illuminating the object byactivating at least a portion of the display response to at least one ofthe one or more sensors detecting the presence and the relative locationof the object positioned adjacent to the first side of the mirror.